flyingfishinwater
/

good_and_small_models

@@ -7,6 +7,8 @@ on the App Store.
 [Privacy AI](https://apps.apple.com/app/apple-store/id6738392421?pt=127450194&ct=huggingface&mt=8) is a lightweight, serverless application. All tools - including web search, stock quotes, and Health analysis - run on-device, keeping data and actions fully private. It supports both local AI models and connections to your own OpenAI-compatible servers.
 ## Qwen3 4B Q4
 Qwen3 is the latest generation of Qwen series. It is a large language model with 1.7B parameters, optimized for mobile devices. It is capable of running functions on mobile devices and has been trained to follow instructions and generate long texts (32K tokens). It is more resilient to the diversity of system prompts, enhancing role-play implementation and condition-setting for chatbots. It has up to 128K tokens and can generate up to 32K tokens. It supports for over 100 languages, including Chinese, English, French, Spanish, Portuguese, German, Italian, Russian, Japanese, Korean, Vietnamese, Thai, Arabic, and more.
@@ -124,40 +126,33 @@ Gemma 3n models are designed for efficient execution on low-resource devices. Th
 ---
-## SmolLM2 1.7B
-SmolLM2 was trained on 11 trillion tokens and demonstrates significant advances over other small models, particularly in instruction following, knowledge, reasoning, and mathematics.
-**Model Intention:** SmolLM2 is capable of solving a wide range of tasks while being lightweight enough to run on-device
-**Model URL:** [https://huggingface.co/flyingfishinwater/good_and_small_models/resolve/main/smollm2-1.7b-instruct-q4_k_m.gguf?download=true](https://huggingface.co/flyingfishinwater/good_and_small_models/resolve/main/smollm2-1.7b-instruct-q4_k_m.gguf?download=true)
-**Model Info URL:** [https://huggingface.co/HuggingFaceTB/SmolLM2-1.7B-Instruct](https://huggingface.co/HuggingFaceTB/SmolLM2-1.7B-Instruct)
-**Model License:** [License Info](https://choosealicense.com/licenses/apache-2.0/)
-**Model Description:** SmolLM2 was trained on 11 trillion tokens and demonstrates significant advances over other small models, particularly in instruction following, knowledge, reasoning, and mathematics.
 **Developer:** [https://huggingface.co/HuggingFaceTB](https://huggingface.co/HuggingFaceTB)
-**Update Date:** 2024-11-02
-**File Size:** 1060 MB
-**Context Length:** 8192 tokens
 **Prompt Format:**
 ```
-<|im_start|>system
-{{system}}<|im_end|>
-<|im_start|>user
-{{prompt}}<|im_end|>
-<|im_start|>assistant
 ```
-**Template Name:** chatml
 **Add BOS Token:** Yes
@@ -279,25 +274,25 @@ ERNIE 4.5 is a series of open source models created by Baidu. The advanced capab
 ---
-## SmolLM3 3B
-SmolLM3 is a fully open model that offers strong performance at the 3B–4B scale. The model is a decoder-only transformer using GQA and NoPE (with 3:1 ratio), it was pretrained on 11.2T tokens with a staged curriculum of web, code, math and reasoning data. Post-training included midtraining on 140B reasoning tokens.
-**Model Intention:** SmolLM3 is a 3B parameter language model designed to push the boundaries of small models. It supports 6 languages (English, French, Spanish, German, Italian, and Portuguese), advanced reasoning and long context.
-**Model URL:** [https://huggingface.co/flyingfishinwater/good_and_small_models/resolve/main/SmolLM3-Q4_K_M.gguf?download=true](https://huggingface.co/flyingfishinwater/good_and_small_models/resolve/main/SmolLM3-Q4_K_M.gguf?download=true)
-**Model Info URL:** [https://huggingface.co/HuggingFaceTB/SmolLM3-3B](https://huggingface.co/HuggingFaceTB/SmolLM3-3B)
-**Model License:** [License Info](https://www.apache.org/licenses/LICENSE-2.0.txt)
-**Model Description:** SmolLM3 is a fully open model that offers strong performance at the 3B–4B scale. The model is a decoder-only transformer using GQA and NoPE (with 3:1 ratio), it was pretrained on 11.2T tokens with a staged curriculum of web, code, math and reasoning data. Post-training included midtraining on 140B reasoning tokens.
-**Developer:** [https://huggingface.co/HuggingFaceTB](https://huggingface.co/HuggingFaceTB)
-**File Size:** 1920 MB
-**Context Length:** 2048 tokens
 **Prompt Format:**
@@ -316,25 +311,25 @@ SmolLM3 is a fully open model that offers strong performance at the 3B–4B scal
 ---
-## LFM2 1.2B
-LFM2 is a new generation of hybrid models developed by Liquid AI, specifically designed for edge AI and on-device deployment. It sets a new standard in terms of quality, speed, and memory efficiency. LFM2 is a new hybrid Liquid model with multiplicative gates and short convolutions. It supported languages: English, Arabic, Chinese, French, German, Japanese, Korean, and Spanish.
-**Model Intention:** LFM2 1.2B is particularly suited for agentic tasks, data extraction, RAG, creative writing, and multi-turn conversations
-**Model URL:** [https://huggingface.co/flyingfishinwater/good_and_small_models/resolve/main/LFM2-1.2B-Q4_0.gguf?download=true](https://huggingface.co/flyingfishinwater/good_and_small_models/resolve/main/LFM2-1.2B-Q4_0.gguf?download=true)
-**Model Info URL:** [https://huggingface.co/LiquidAI/LFM2-1.2B](https://huggingface.co/LiquidAI/LFM2-1.2B)
-**Model License:** [License Info](https://huggingface.co/LiquidAI/LFM2-1.2B/raw/main/LICENSE)
-**Model Description:** LFM2 is a new generation of hybrid models developed by Liquid AI, specifically designed for edge AI and on-device deployment. It sets a new standard in terms of quality, speed, and memory efficiency. LFM2 is a new hybrid Liquid model with multiplicative gates and short convolutions. It supported languages: English, Arabic, Chinese, French, German, Japanese, Korean, and Spanish.
-**Developer:** [https://huggingface.co/LiquidAI](https://huggingface.co/LiquidAI)
-**File Size:** 696 MB
-**Context Length:** 1024 tokens
 **Prompt Format:**

 [Privacy AI](https://apps.apple.com/app/apple-store/id6738392421?pt=127450194&ct=huggingface&mt=8) is a lightweight, serverless application. All tools - including web search, stock quotes, and Health analysis - run on-device, keeping data and actions fully private. It supports both local AI models and connections to your own OpenAI-compatible servers.
+Refer more information on [Privacy AI Official Site:](https://privacyai.acmeup.com)
 ## Qwen3 4B Q4
 Qwen3 is the latest generation of Qwen series. It is a large language model with 1.7B parameters, optimized for mobile devices. It is capable of running functions on mobile devices and has been trained to follow instructions and generate long texts (32K tokens). It is more resilient to the diversity of system prompts, enhancing role-play implementation and condition-setting for chatbots. It has up to 128K tokens and can generate up to 32K tokens. It supports for over 100 languages, including Chinese, English, French, Spanish, Portuguese, German, Italian, Russian, Japanese, Korean, Vietnamese, Thai, Arabic, and more.
 ---
+## SmolLM3 3B
+SmolLM3 is a fully open model that offers strong performance at the 3B–4B scale. The model is a decoder-only transformer using GQA and NoPE (with 3:1 ratio), it was pretrained on 11.2T tokens with a staged curriculum of web, code, math and reasoning data. Post-training included midtraining on 140B reasoning tokens.
+**Model Intention:** SmolLM3 is a 3B parameter language model designed to push the boundaries of small models. It supports 6 languages (English, French, Spanish, German, Italian, and Portuguese), advanced reasoning and long context.
+**Model URL:** [https://huggingface.co/flyingfishinwater/good_and_small_models/resolve/main/SmolLM3-Q4_K_M.gguf?download=true](https://huggingface.co/flyingfishinwater/good_and_small_models/resolve/main/SmolLM3-Q4_K_M.gguf?download=true)
+**Model Info URL:** [https://huggingface.co/HuggingFaceTB/SmolLM3-3B](https://huggingface.co/HuggingFaceTB/SmolLM3-3B)
+**Model License:** [License Info](https://www.apache.org/licenses/LICENSE-2.0.txt)
+**Model Description:** SmolLM3 is a fully open model that offers strong performance at the 3B–4B scale. The model is a decoder-only transformer using GQA and NoPE (with 3:1 ratio), it was pretrained on 11.2T tokens with a staged curriculum of web, code, math and reasoning data. Post-training included midtraining on 140B reasoning tokens.
 **Developer:** [https://huggingface.co/HuggingFaceTB](https://huggingface.co/HuggingFaceTB)
+**File Size:** 1920 MB
+**Context Length:** 2048 tokens
 **Prompt Format:**
 ```
 ```
+**Template Name:** qwen
 **Add BOS Token:** Yes
 ---
+## LFM2 1.2B
+LFM2 is a new generation of hybrid models developed by Liquid AI, specifically designed for edge AI and on-device deployment. It sets a new standard in terms of quality, speed, and memory efficiency. LFM2 is a new hybrid Liquid model with multiplicative gates and short convolutions. It supported languages: English, Arabic, Chinese, French, German, Japanese, Korean, and Spanish.
+**Model Intention:** LFM2 1.2B is particularly suited for agentic tasks, data extraction, RAG, creative writing, and multi-turn conversations
+**Model URL:** [https://huggingface.co/flyingfishinwater/good_and_small_models/resolve/main/LFM2-1.2B-Q4_0.gguf?download=true](https://huggingface.co/flyingfishinwater/good_and_small_models/resolve/main/LFM2-1.2B-Q4_0.gguf?download=true)
+**Model Info URL:** [https://huggingface.co/LiquidAI/LFM2-1.2B](https://huggingface.co/LiquidAI/LFM2-1.2B)
+**Model License:** [License Info](https://huggingface.co/LiquidAI/LFM2-1.2B/raw/main/LICENSE)
+**Model Description:** LFM2 is a new generation of hybrid models developed by Liquid AI, specifically designed for edge AI and on-device deployment. It sets a new standard in terms of quality, speed, and memory efficiency. LFM2 is a new hybrid Liquid model with multiplicative gates and short convolutions. It supported languages: English, Arabic, Chinese, French, German, Japanese, Korean, and Spanish.
+**Developer:** [https://huggingface.co/LiquidAI](https://huggingface.co/LiquidAI)
+**File Size:** 696 MB
+**Context Length:** 1024 tokens
 **Prompt Format:**
 ---
+## Jan v1 4B
+Jan-v1-4B is an advanced agentic language model with 4.02 billion parameters, built on Qwen3-4B-Thinking. It is specifically designed for agentic reasoning and problem-solving, optimized for integration with Jan App. The model achieves strong performance on chat and question-answering benchmarks with improved reasoning capabilities, making it ideal for complex task automation and intelligent agent applications.
+**Model Intention:** Advanced agentic language model optimized for reasoning and problem-solving with 91.1% accuracy on question answering
+**Model URL:** [https://huggingface.co/flyingfishinwater/good_and_small_models/resolve/main/Jan-v1-4B-Q4_0.gguf?download=true](https://huggingface.co/flyingfishinwater/good_and_small_models/resolve/main/Jan-v1-4B-Q4_0.gguf?download=true)
+**Model Info URL:** [https://huggingface.co/janhq/Jan-v1-4B](https://huggingface.co/janhq/Jan-v1-4B)
+**Model License:** [License Info](https://www.apache.org/licenses/LICENSE-2.0.txt)
+**Model Description:** Jan-v1-4B is an advanced agentic language model with 4.02 billion parameters, built on Qwen3-4B-Thinking. It is specifically designed for agentic reasoning and problem-solving, optimized for integration with Jan App. The model achieves strong performance on chat and question-answering benchmarks with improved reasoning capabilities, making it ideal for complex task automation and intelligent agent applications.
+**Developer:** [https://huggingface.co/janhq](https://huggingface.co/janhq)
+**File Size:** 2400 MB
+**Context Length:** 2048 tokens
 **Prompt Format:**