flyingfishinwater commited on
Commit
3f0ed1a
·
verified ·
1 Parent(s): 6863d28

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +82 -8
README.md CHANGED
@@ -9,25 +9,62 @@ on the App Store.
9
 
10
  Refer more information on [Privacy AI Official Site:](https://privacyai.acmeup.com)
11
 
12
- ## Qwen3 4B Q4
13
 
14
- Qwen3 is the latest generation of Qwen series. It is a large language model with 1.7B parameters, optimized for mobile devices. It is capable of running functions on mobile devices and has been trained to follow instructions and generate long texts (32K tokens). It is more resilient to the diversity of system prompts, enhancing role-play implementation and condition-setting for chatbots. It has up to 128K tokens and can generate up to 32K tokens. It supports for over 100 languages, including Chinese, English, French, Spanish, Portuguese, German, Italian, Russian, Japanese, Korean, Vietnamese, Thai, Arabic, and more.
15
 
16
- **Model Intention:** It is 4B of Qwen3 series that is excellent for summary, translation and MCP tool calling
17
 
18
- **Model URL:** [https://huggingface.co/flyingfishinwater/good_and_small_models/resolve/main/Qwen3-4B-IQ4_NL.gguf?download=true](https://huggingface.co/flyingfishinwater/good_and_small_models/resolve/main/Qwen3-4B-IQ4_NL.gguf?download=true)
19
 
20
- **Model Info URL:** [https://huggingface.co/Qwen/Qwen3-4B](https://huggingface.co/Qwen/Qwen3-4B)
21
 
22
  **Model License:** [License Info](https://www.apache.org/licenses/LICENSE-2.0.txt)
23
 
24
- **Model Description:** Qwen3 is the latest generation of Qwen series. It is a large language model with 1.7B parameters, optimized for mobile devices. It is capable of running functions on mobile devices and has been trained to follow instructions and generate long texts (32K tokens). It is more resilient to the diversity of system prompts, enhancing role-play implementation and condition-setting for chatbots. It has up to 128K tokens and can generate up to 32K tokens. It supports for over 100 languages, including Chinese, English, French, Spanish, Portuguese, German, Italian, Russian, Japanese, Korean, Vietnamese, Thai, Arabic, and more.
25
 
26
  **Developer:** [https://huggingface.co/Qwen](https://huggingface.co/Qwen)
27
 
28
- **File Size:** 2230 MB
29
 
30
- **Context Length:** 1024 tokens
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
31
 
32
  **Prompt Format:**
33
 
@@ -457,4 +494,41 @@ Qwen3 1.7B Uncensored is an unrestricted variant designed for creative writing a
457
  **Parse Special Tokens:** Yes
458
 
459
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
460
  ---
 
9
 
10
  Refer more information on [Privacy AI Official Site:](https://privacyai.acmeup.com)
11
 
12
+ ## Qwen3 4B Instruct 2507
13
 
14
+ Qwen3-4B-Instruct-2507 is the latest 4B parameter model in the Qwen3 series, featuring significant improvements in reasoning, mathematics, science, coding, and tool usage. With 262K context length and strong multilingual support, it excels at instruction following, logical reasoning, and complex problem-solving tasks.
15
 
16
+ **Model Intention:** Latest Qwen3-4B Instruct model with enhanced reasoning, logical thinking, mathematics, science, coding, and tool usage capabilities
17
 
18
+ **Model URL:** [https://huggingface.co/flyingfishinwater/good_and_small_models/resolve/main/Qwen3-4B-Instruct-2507-Q4_0.gguf](https://huggingface.co/flyingfishinwater/good_and_small_models/resolve/main/Qwen3-4B-Instruct-2507-Q4_0.gguf)
19
 
20
+ **Model Info URL:** [https://huggingface.co/Qwen/Qwen3-4B-Instruct-2507](https://huggingface.co/Qwen/Qwen3-4B-Instruct-2507)
21
 
22
  **Model License:** [License Info](https://www.apache.org/licenses/LICENSE-2.0.txt)
23
 
24
+ **Model Description:** Qwen3-4B-Instruct-2507 is the latest 4B parameter model in the Qwen3 series, featuring significant improvements in reasoning, mathematics, science, coding, and tool usage. With 262K context length and strong multilingual support, it excels at instruction following, logical reasoning, and complex problem-solving tasks.
25
 
26
  **Developer:** [https://huggingface.co/Qwen](https://huggingface.co/Qwen)
27
 
28
+ **File Size:** 2400 MB
29
 
30
+ **Context Length:** 2048 tokens
31
+
32
+ **Prompt Format:**
33
+
34
+ ```
35
+
36
+ ```
37
+
38
+ **Template Name:** qwen
39
+
40
+ **Add BOS Token:** Yes
41
+
42
+ **Add EOS Token:** No
43
+
44
+ **Parse Special Tokens:** Yes
45
+
46
+
47
+ ---
48
+
49
+ ## Qwen3 4B Thinking 2507
50
+
51
+ Qwen3-4B-Thinking-2507 is a specialized variant of the Qwen3-4B series with enhanced reasoning capabilities. It features thinking mode enabled by default, providing significantly improved performance on complex reasoning tasks including logical reasoning, mathematics, science, coding, and academic benchmarks with 262K context length.
52
+
53
+ **Model Intention:** Advanced reasoning model with thinking mode enabled for complex logical reasoning, mathematics, science, and coding tasks
54
+
55
+ **Model URL:** [https://huggingface.co/flyingfishinwater/good_and_small_models/resolve/main/Qwen3-4B-Thinking-2507-Q4_0.gguf](https://huggingface.co/flyingfishinwater/good_and_small_models/resolve/main/Qwen3-4B-Thinking-2507-Q4_0.gguf)
56
+
57
+ **Model Info URL:** [https://huggingface.co/Qwen/Qwen3-4B-Thinking-2507](https://huggingface.co/Qwen/Qwen3-4B-Thinking-2507)
58
+
59
+ **Model License:** [License Info](https://www.apache.org/licenses/LICENSE-2.0.txt)
60
+
61
+ **Model Description:** Qwen3-4B-Thinking-2507 is a specialized variant of the Qwen3-4B series with enhanced reasoning capabilities. It features thinking mode enabled by default, providing significantly improved performance on complex reasoning tasks including logical reasoning, mathematics, science, coding, and academic benchmarks with 262K context length.
62
+
63
+ **Developer:** [https://huggingface.co/Qwen](https://huggingface.co/Qwen)
64
+
65
+ **File Size:** 2100 MB
66
+
67
+ **Context Length:** 2048 tokens
68
 
69
  **Prompt Format:**
70
 
 
494
  **Parse Special Tokens:** Yes
495
 
496
 
497
+ ---
498
+
499
+ ## Gemma 3 270M
500
+
501
+ Gemma 3 270M is an ultra-compact transformer model with 268M parameters, designed for efficient deployment on mobile and edge devices. Part of Google's Gemma family, it offers strong performance for its size with 32K context length, multilingual support, and responsible AI design. Ideal for applications requiring fast inference with minimal computational resources while maintaining quality text generation capabilities.
502
+
503
+ **Model Intention:** Ultra-compact 270M parameter model optimized for resource-constrained environments with 32K context length
504
+
505
+ **Model URL:** [https://huggingface.co/flyingfishinwater/good_and_small_models/resolve/main/gemma-3-270m-q4_0.gguf](https://huggingface.co/flyingfishinwater/good_and_small_models/resolve/main/gemma-3-270m-q4_0.gguf)
506
+
507
+ **Model Info URL:** [https://huggingface.co/google/gemma-3-270m](https://huggingface.co/google/gemma-3-270m)
508
+
509
+ **Model License:** [License Info](https://ai.google.dev/gemma/terms)
510
+
511
+ **Model Description:** Gemma 3 270M is an ultra-compact transformer model with 268M parameters, designed for efficient deployment on mobile and edge devices. Part of Google's Gemma family, it offers strong performance for its size with 32K context length, multilingual support, and responsible AI design. Ideal for applications requiring fast inference with minimal computational resources while maintaining quality text generation capabilities.
512
+
513
+ **Developer:** [https://huggingface.co/google](https://huggingface.co/google)
514
+
515
+ **File Size:** 160 MB
516
+
517
+ **Context Length:** 2048 tokens
518
+
519
+ **Prompt Format:**
520
+
521
+ ```
522
+
523
+ ```
524
+
525
+ **Template Name:** gemma
526
+
527
+ **Add BOS Token:** Yes
528
+
529
+ **Add EOS Token:** No
530
+
531
+ **Parse Special Tokens:** Yes
532
+
533
+
534
  ---