--- base_model: - prithivMLmods/Qwen3.5-4B-DS-v4-Flash-v1.0 tags: - text-generation-inference - llama-cpp - general-purpose - flash - math - reasoning - sft - deepseek-v4 - abliterated license: apache-2.0 language: - en pipeline_tag: image-text-to-text library_name: transformers --- # **Qwen3.5-4B-DS-v4-Flash-v1.0-GGUF** > **Qwen3.5-4B-DS-v4-Flash-v1.0** is a reasoning-capable **4B-parameter** language model built on top of **Qwen/Qwen3.5-4B**. The model was trained using a **single-stage long-context training pipeline** with approximately **4.5K long-context DeepSeek V4 Flash reasoning traces**, along with additional high-quality reasoning traces, to improve long-form reasoning, mathematical problem solving, scientific analysis, coding, and instruction-following capabilities. > [!NOTE] > This model is an experimental release and may generate unexpected behaviors or reasoning artifacts in certain scenarios. ## Model Files File Name | Quant Type | File Size | File Link | |-----------|------------|-----------|-----------| | Qwen3.5-4B-DS-v4-Flash-v1.0.BF16.gguf | BF16 | 8.42 GB | [Download](https://huggingface.co/prithivMLmods/Qwen3.5-4B-DS-v4-Flash-v1.0-GGUF/blob/main/Qwen3.5-4B-DS-v4-Flash-v1.0.BF16.gguf) | | Qwen3.5-4B-DS-v4-Flash-v1.0.F16.gguf | F16 | 8.42 GB | [Download](https://huggingface.co/prithivMLmods/Qwen3.5-4B-DS-v4-Flash-v1.0-GGUF/blob/main/Qwen3.5-4B-DS-v4-Flash-v1.0.F16.gguf) | | Qwen3.5-4B-DS-v4-Flash-v1.0.Q3_K_L.gguf | Q3_K_L | 2.42 GB | [Download](https://huggingface.co/prithivMLmods/Qwen3.5-4B-DS-v4-Flash-v1.0-GGUF/blob/main/Qwen3.5-4B-DS-v4-Flash-v1.0.Q3_K_L.gguf) | | Qwen3.5-4B-DS-v4-Flash-v1.0.Q3_K_M.gguf | Q3_K_M | 2.26 GB | [Download](https://huggingface.co/prithivMLmods/Qwen3.5-4B-DS-v4-Flash-v1.0-GGUF/blob/main/Qwen3.5-4B-DS-v4-Flash-v1.0.Q3_K_M.gguf) | | Qwen3.5-4B-DS-v4-Flash-v1.0.Q3_K_S.gguf | Q3_K_S | 2.07 GB | [Download](https://huggingface.co/prithivMLmods/Qwen3.5-4B-DS-v4-Flash-v1.0-GGUF/blob/main/Qwen3.5-4B-DS-v4-Flash-v1.0.Q3_K_S.gguf) | | Qwen3.5-4B-DS-v4-Flash-v1.0.Q4_K_M.gguf | Q4_K_M | 2.71 GB | [Download](https://huggingface.co/prithivMLmods/Qwen3.5-4B-DS-v4-Flash-v1.0-GGUF/blob/main/Qwen3.5-4B-DS-v4-Flash-v1.0.Q4_K_M.gguf) | | Qwen3.5-4B-DS-v4-Flash-v1.0.Q4_K_S.gguf | Q4_K_S | 2.56 GB | [Download](https://huggingface.co/prithivMLmods/Qwen3.5-4B-DS-v4-Flash-v1.0-GGUF/blob/main/Qwen3.5-4B-DS-v4-Flash-v1.0.Q4_K_S.gguf) | | Qwen3.5-4B-DS-v4-Flash-v1.0.Q5_K_M.gguf | Q5_K_M | 3.07 GB | [Download](https://huggingface.co/prithivMLmods/Qwen3.5-4B-DS-v4-Flash-v1.0-GGUF/blob/main/Qwen3.5-4B-DS-v4-Flash-v1.0.Q5_K_M.gguf) | | Qwen3.5-4B-DS-v4-Flash-v1.0.Q5_K_S.gguf | Q5_K_S | 2.99 GB | [Download](https://huggingface.co/prithivMLmods/Qwen3.5-4B-DS-v4-Flash-v1.0-GGUF/blob/main/Qwen3.5-4B-DS-v4-Flash-v1.0.Q5_K_S.gguf) | | Qwen3.5-4B-DS-v4-Flash-v1.0.Q8_0.gguf | Q8_0 | 4.48 GB | [Download](https://huggingface.co/prithivMLmods/Qwen3.5-4B-DS-v4-Flash-v1.0-GGUF/blob/main/Qwen3.5-4B-DS-v4-Flash-v1.0.Q8_0.gguf) | | Qwen3.5-4B-DS-v4-Flash-v1.0.mmproj-bf16.gguf | mmproj-bf16 | 676 MB | [Download](https://huggingface.co/prithivMLmods/Qwen3.5-4B-DS-v4-Flash-v1.0-GGUF/blob/main/Qwen3.5-4B-DS-v4-Flash-v1.0.mmproj-bf16.gguf) | | Qwen3.5-4B-DS-v4-Flash-v1.0.mmproj-f16.gguf | mmproj-f16 | 676 MB | [Download](https://huggingface.co/prithivMLmods/Qwen3.5-4B-DS-v4-Flash-v1.0-GGUF/blob/main/Qwen3.5-4B-DS-v4-Flash-v1.0.mmproj-f16.gguf) | | Qwen3.5-4B-DS-v4-Flash-v1.0.mmproj-q8_0.gguf | mmproj-q8_0 | 367 MB | [Download](https://huggingface.co/prithivMLmods/Qwen3.5-4B-DS-v4-Flash-v1.0-GGUF/blob/main/Qwen3.5-4B-DS-v4-Flash-v1.0.mmproj-q8_0.gguf) | ## llama.cpp LLM inference in C/C++ — https://github.com/ggml-org/llama.cpp