flyingfishinwater commited on
Commit
9834152
·
verified ·
1 Parent(s): 7b2136f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +56 -8
README.md CHANGED
@@ -1,4 +1,15 @@
1
- # Qwen3 4B Q4
 
 
 
 
 
 
 
 
 
 
 
2
 
3
  Qwen3 is the latest generation of Qwen series. It is a large language model with 1.7B parameters, optimized for mobile devices. It is capable of running functions on mobile devices and has been trained to follow instructions and generate long texts (32K tokens). It is more resilient to the diversity of system prompts, enhancing role-play implementation and condition-setting for chatbots. It has up to 128K tokens and can generate up to 32K tokens. It supports for over 100 languages, including Chinese, English, French, Spanish, Portuguese, German, Italian, Russian, Japanese, Korean, Vietnamese, Thai, Arabic, and more.
4
 
@@ -35,7 +46,7 @@ Qwen3 is the latest generation of Qwen series. It is a large language model with
35
 
36
  ---
37
 
38
- # GLM Edge 4B Chat
39
 
40
  GLM-4 is the latest generation of pre-trained models in the GLM-4 series launched by Zhipu AI. In the evaluation of data sets in semantics, mathematics, reasoning, code, and knowledge, GLM-4 has shown superior performance beyond Llama-3. In addition to multi-round conversations, GLM-4-Chat also has advanced features such as web browsing, code execution, custom tool calls (Function Call), and long text reasoning (supporting up to 128K context). This generation of models has added multi-language support, supporting 26 languages including Japanese, Korean, and German.
41
 
@@ -76,7 +87,7 @@ GLM-4 is the latest generation of pre-trained models in the GLM-4 series launche
76
 
77
  ---
78
 
79
- # Gemma 3n E2B it
80
 
81
  Gemma 3n models are designed for efficient execution on low-resource devices. They are capable of multimodal input, handling text, image, video, and audio input, and generating text outputs, with open weights for pre-trained and instruction-tuned variants. These models were trained with data in over 140 spoken languages.
82
 
@@ -115,7 +126,7 @@ Gemma 3n models are designed for efficient execution on low-resource devices. Th
115
 
116
  ---
117
 
118
- # SmolLM2 1.7B
119
 
120
  SmolLM2 was trained on 11 trillion tokens and demonstrates significant advances over other small models, particularly in instruction following, knowledge, reasoning, and mathematics.
121
 
@@ -159,7 +170,7 @@ SmolLM2 was trained on 11 trillion tokens and demonstrates significant advances
159
 
160
  ---
161
 
162
- # Phi4 mini 4B
163
 
164
  Phi-4-mini-instruct is a lightweight open model built upon synthetic data and filtered publicly available websites - with a focus on high-quality, reasoning dense data. The model is intended for broad multilingual commercial and research use. The model provides uses for general purpose AI systems and applications which require: 1). Memory/compute constrained environments; 2). Latency bound scenarios; 3) Strong reasoning (especially math and logic). The model is designed to accelerate research on language and multimodal models, for use as a building block for generative AI powered features.
165
 
@@ -196,7 +207,7 @@ Phi-4-mini-instruct is a lightweight open model built upon synthetic data and fi
196
 
197
  ---
198
 
199
- # Qwen3 1.7B
200
 
201
  Qwen3 1.7B is one of the small models in the Qwen series, designed for efficiency and speed. It can run seamlessly on edge devices, enabling rapid inference and real-time applications. This compact model is ideal for testing scenarios, prototyping, or deployment in resource-constrained environments.
202
 
@@ -233,7 +244,7 @@ Qwen3 1.7B is one of the small models in the Qwen series, designed for efficienc
233
 
234
  ---
235
 
236
- # ERNIE-4.5 0.3B
237
 
238
  ERNIE 4.5 is a series of open source models created by Baidu. The advanced capabilities of the ERNIE 4.5 models, particularly the MoE-based A47B and A3B series, are underpinned by several key technical innovations: 1. Multimodal Heterogeneous MoE Pre-Training; 2. Scaling-Efficient Infrastructure; 3. Modality-Specific Post-Training
239
 
@@ -270,7 +281,7 @@ ERNIE 4.5 is a series of open source models created by Baidu. The advanced capab
270
 
271
  ---
272
 
273
- # SmolLM3 3B
274
 
275
  SmolLM3 is a fully open model that offers strong performance at the 3B–4B scale. The model is a decoder-only transformer using GQA and NoPE (with 3:1 ratio), it was pretrained on 11.2T tokens with a staged curriculum of web, code, math and reasoning data. Post-training included midtraining on 140B reasoning tokens.
276
 
@@ -305,4 +316,41 @@ SmolLM3 is a fully open model that offers strong performance at the 3B–4B scal
305
  **Parse Special Tokens:** Yes
306
 
307
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
308
  ---
 
1
+ # Good and Small models for Mobile Devices
2
+
3
+ Try them out in
4
+
5
+ ![PrivacyAIIcon](https://www.acmeup.com/icons/32.png) [Privacy AI](https://apps.apple.com/app/apple-store/id6738392421?pt=127450194&ct=huggingface&mt=8)
6
+
7
+ on the App Store.
8
+
9
+ [Privacy AI](https://apps.apple.com/app/apple-store/id6738392421?pt=127450194&ct=huggingface&mt=8) is a lightweight, serverless application. All tools - including web search, stock quotes, and Health analysis - run on-device, keeping data and actions fully private. It supports both local AI models and connections to your own OpenAI-compatible servers.
10
+
11
+
12
+ ## Qwen3 4B Q4
13
 
14
  Qwen3 is the latest generation of Qwen series. It is a large language model with 1.7B parameters, optimized for mobile devices. It is capable of running functions on mobile devices and has been trained to follow instructions and generate long texts (32K tokens). It is more resilient to the diversity of system prompts, enhancing role-play implementation and condition-setting for chatbots. It has up to 128K tokens and can generate up to 32K tokens. It supports for over 100 languages, including Chinese, English, French, Spanish, Portuguese, German, Italian, Russian, Japanese, Korean, Vietnamese, Thai, Arabic, and more.
15
 
 
46
 
47
  ---
48
 
49
+ ## GLM Edge 4B Chat
50
 
51
  GLM-4 is the latest generation of pre-trained models in the GLM-4 series launched by Zhipu AI. In the evaluation of data sets in semantics, mathematics, reasoning, code, and knowledge, GLM-4 has shown superior performance beyond Llama-3. In addition to multi-round conversations, GLM-4-Chat also has advanced features such as web browsing, code execution, custom tool calls (Function Call), and long text reasoning (supporting up to 128K context). This generation of models has added multi-language support, supporting 26 languages including Japanese, Korean, and German.
52
 
 
87
 
88
  ---
89
 
90
+ ## Gemma 3n E2B it
91
 
92
  Gemma 3n models are designed for efficient execution on low-resource devices. They are capable of multimodal input, handling text, image, video, and audio input, and generating text outputs, with open weights for pre-trained and instruction-tuned variants. These models were trained with data in over 140 spoken languages.
93
 
 
126
 
127
  ---
128
 
129
+ ## SmolLM2 1.7B
130
 
131
  SmolLM2 was trained on 11 trillion tokens and demonstrates significant advances over other small models, particularly in instruction following, knowledge, reasoning, and mathematics.
132
 
 
170
 
171
  ---
172
 
173
+ ## Phi4 mini 4B
174
 
175
  Phi-4-mini-instruct is a lightweight open model built upon synthetic data and filtered publicly available websites - with a focus on high-quality, reasoning dense data. The model is intended for broad multilingual commercial and research use. The model provides uses for general purpose AI systems and applications which require: 1). Memory/compute constrained environments; 2). Latency bound scenarios; 3) Strong reasoning (especially math and logic). The model is designed to accelerate research on language and multimodal models, for use as a building block for generative AI powered features.
176
 
 
207
 
208
  ---
209
 
210
+ ## Qwen3 1.7B
211
 
212
  Qwen3 1.7B is one of the small models in the Qwen series, designed for efficiency and speed. It can run seamlessly on edge devices, enabling rapid inference and real-time applications. This compact model is ideal for testing scenarios, prototyping, or deployment in resource-constrained environments.
213
 
 
244
 
245
  ---
246
 
247
+ ## ERNIE-4.5 0.3B
248
 
249
  ERNIE 4.5 is a series of open source models created by Baidu. The advanced capabilities of the ERNIE 4.5 models, particularly the MoE-based A47B and A3B series, are underpinned by several key technical innovations: 1. Multimodal Heterogeneous MoE Pre-Training; 2. Scaling-Efficient Infrastructure; 3. Modality-Specific Post-Training
250
 
 
281
 
282
  ---
283
 
284
+ ## SmolLM3 3B
285
 
286
  SmolLM3 is a fully open model that offers strong performance at the 3B–4B scale. The model is a decoder-only transformer using GQA and NoPE (with 3:1 ratio), it was pretrained on 11.2T tokens with a staged curriculum of web, code, math and reasoning data. Post-training included midtraining on 140B reasoning tokens.
287
 
 
316
  **Parse Special Tokens:** Yes
317
 
318
 
319
+ ---
320
+
321
+ ## LFM2 1.2B
322
+
323
+ LFM2 is a new generation of hybrid models developed by Liquid AI, specifically designed for edge AI and on-device deployment. It sets a new standard in terms of quality, speed, and memory efficiency. LFM2 is a new hybrid Liquid model with multiplicative gates and short convolutions. It supported languages: English, Arabic, Chinese, French, German, Japanese, Korean, and Spanish.
324
+
325
+ **Model Intention:** LFM2 1.2B is particularly suited for agentic tasks, data extraction, RAG, creative writing, and multi-turn conversations
326
+
327
+ **Model URL:** [https://huggingface.co/flyingfishinwater/good_and_small_models/resolve/main/LFM2-1.2B-Q4_0.gguf?download=true](https://huggingface.co/flyingfishinwater/good_and_small_models/resolve/main/LFM2-1.2B-Q4_0.gguf?download=true)
328
+
329
+ **Model Info URL:** [https://huggingface.co/LiquidAI/LFM2-1.2B](https://huggingface.co/LiquidAI/LFM2-1.2B)
330
+
331
+ **Model License:** [License Info](https://huggingface.co/LiquidAI/LFM2-1.2B/raw/main/LICENSE)
332
+
333
+ **Model Description:** LFM2 is a new generation of hybrid models developed by Liquid AI, specifically designed for edge AI and on-device deployment. It sets a new standard in terms of quality, speed, and memory efficiency. LFM2 is a new hybrid Liquid model with multiplicative gates and short convolutions. It supported languages: English, Arabic, Chinese, French, German, Japanese, Korean, and Spanish.
334
+
335
+ **Developer:** [https://huggingface.co/LiquidAI](https://huggingface.co/LiquidAI)
336
+
337
+ **File Size:** 696 MB
338
+
339
+ **Context Length:** 1024 tokens
340
+
341
+ **Prompt Format:**
342
+
343
+ ```
344
+
345
+ ```
346
+
347
+ **Template Name:** qwen
348
+
349
+ **Add BOS Token:** Yes
350
+
351
+ **Add EOS Token:** No
352
+
353
+ **Parse Special Tokens:** Yes
354
+
355
+
356
  ---