Edit Models filters

Model Tree

Qwen/Qwen3-4B-Thinking-2507

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

135

Base only

Active filters: Qwen/Qwen3-4B-Thinking-2507

elichen-skymizer/Qwen3-4B-Thinking-2507-Q4_K_M-GGUF

Text Generation • 4B • Updated Aug 12, 2025 • 47

elichen-skymizer/Qwen3-4B-Thinking-2507-Q5_K_M-GGUF

Text Generation • 4B • Updated Aug 12, 2025 • 12

elichen-skymizer/Qwen3-4B-Thinking-2507-Q6_K-GGUF

Text Generation • 4B • Updated Aug 12, 2025 • 67 • 1

elichen-skymizer/Qwen3-4B-Thinking-2507-Q8_0-GGUF

Text Generation • 4B • Updated Aug 12, 2025 • 7

Eslzzyl/Qwen3-4B-Thinking-2507-AWQ

Text Generation • 4B • Updated Aug 12, 2025 • 11 • 1

Mungert/Jan-v1-4B-GGUF

Text Generation • 4B • Updated Sep 24, 2025 • 146

mradermacher/Qwen3-4B-Thinking-2507-GGUF

4B • Updated Aug 15, 2025 • 103 • 1

mradermacher/Qwen3-4B-Thinking-2507-i1-GGUF

4B • Updated Dec 9, 2025 • 277

brokilone/Qwen3-4B-Thinking-2507-Q4_K_M-GGUF

Text Generation • 4B • Updated Aug 17, 2025 • 64 • 1

AdvRahul/Axion-Thinking-4B

4B • Updated Oct 7, 2025 • 38

adeelahmad/ReasonableQwen3-4B

Text Generation • 4B • Updated Mar 30 • 230 • 6

ertghiu256/Qwen3-4B-Thinking-2507-Hermes-3

4B • Updated Sep 1, 2025 • 151 • 2

driaforall/mem-agent-mlx-4bit

Text Generation • 0.6B • Updated Sep 9, 2025 • 66 • 5

JunHowie/Qwen3-4B-Thinking-2507-GPTQ-Int4

Text Generation • 4B • Updated Sep 4, 2025 • 103 • 1

JunHowie/Qwen3-4B-Thinking-2507-GPTQ-Int8

Text Generation • 4B • Updated Sep 4, 2025 • 6 • 2

driaforall/mem-agent-mlx-8bit

Text Generation • 1B • Updated Sep 9, 2025 • 5 • 2

DevQuasar/Qwen.Qwen3-4B-Thinking-2507-NVFP4A16

Text Generation • 3B • Updated Sep 4, 2025 • 9

remodlai/Qwen3-4B-Thinking-2507-Nova-fp8

4B • Updated Sep 6, 2025 • 9

AmpereComputing/qwen-3-4b-2507-thinking-gguf

4B • Updated Sep 11, 2025 • 10

quelmap/Lightning-4b-GGUF

Text Generation • 4B • Updated Sep 20, 2025 • 116 • 1

quelmap/Lightning-4b-GGUF-short-ctx

Text Generation • 4B • Updated Sep 20, 2025 • 171 • 1

ggml-org/Qwen3-4B-Thinking-2507-Q8_0-GGUF

Text Generation • 4B • Updated Sep 22, 2025 • 103 • 2

itroot/Qwen3-4B-Thinking-2507-W8A8

Text Generation • 4B • Updated Sep 24, 2025 • 23

SandLogicTechnologies/Qwen3-4B-Thinking-2507-GGUF

Text Generation • 4B • Updated Sep 29, 2025 • 46

steampunque/Qwen3-4B-Thinking-2507-MP-GGUF

4B • Updated Apr 22 • 22 • 2

fcampanini74/mem-agent-4B-Q4-K-M-GGUF

4B • Updated Oct 12, 2025 • 3

RepublicOfKorokke/Qwen3-4B-Thinking-2507-mlx-mxfp4

Text Generation • 0.8B • Updated Oct 17, 2025 • 15

pramjana/Qwen3-4B-Thinking-2507-4bit-GPTQ

Text Generation • 4B • Updated Oct 30, 2025 • 6

suvadeep29/Luna-4B-thinking

Text Generation • 4B • Updated Oct 22, 2025 • 64 • 2

Alcoft/Qwen_Qwen3-4B-Thinking-2507-GGUF

Text Generation • 4B • Updated Oct 22, 2025 • 2.57k