Edit Models filters

Model Tree

Qwen/Qwen2.5-0.5B-Instruct

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

254

Base only

Active filters: Qwen/Qwen2.5-0.5B-Instruct

v8karlo/Qwen2.5-0.5B-Instruct-Q8_0-GGUF

Text Generation • 0.5B • Updated Oct 2, 2024 • 622 • 1

llmware/qwen2.5-0.5b-instruct-ov

Updated Oct 31, 2024 • 19 • 2

QuantFactory/Reasoning-0.5b-GGUF

0.5B • Updated Oct 7, 2024 • 119 • 2

QuantFactory/Qwen2.5-0.5b-RBase-GGUF

0.5B • Updated Oct 7, 2024 • 244 • 2

QuantFactory/Vikhr-Qwen-2.5-0.5b-Instruct-GGUF

0.5B • Updated Oct 8, 2024 • 178 • 2

RedHatAI/Qwen2.5-0.5B-Instruct-quantized.w8a8

Text Generation • 0.6B • Updated Dec 9, 2024 • 449

ysn-rfd/Qwen2.5-0.5B-Instruct-Q8_0-GGUF

Text Generation • 0.5B • Updated Oct 25, 2024 • 21 • 1

marroyo777/Qwen2.5-0.5B-Instruct-Q4_K_M-GGUF

Text Generation • 0.5B • Updated Oct 28, 2024 • 27

Volko76/Qwen2.5-0.5B-Instruct-Q5_K_M-GGUF

Text Generation • 0.5B • Updated Apr 28, 2025 • 24

Felladrin/gguf-Q8_0-Qwen2.5-0.5B-Instruct

0.5B • Updated Apr 28, 2025 • 14

ll3214/Qwen2.5-0.5B-Instruct-Q4_K_M-GGUF

Text Generation • 0.5B • Updated Nov 2, 2024 • 19

Izhanjafry/Qwen2.5-0.5B-Instruct-Q8_0-GGUF

Text Generation • 0.5B • Updated Nov 5, 2024 • 16

tensorblock/Qwen2.5-0.5B-Instruct-GGUF

Text Generation • 0.5B • Updated Jan 27 • 232

lmstudio-community/Qwen2.5-0.5B-Instruct-MLX-4bit

Text Generation • 77.3M • Updated Nov 13, 2024 • 6.79k • 1

lmstudio-community/Qwen2.5-0.5B-Instruct-MLX-8bit

Text Generation • 0.1B • Updated Nov 13, 2024 • 628

teka38/vicuna_DocMental-0.5b-v3.1-gguf

0.5B • Updated Nov 13, 2024 • 3

osllmai-community/Qwen2.5-0.5B-Instruct-bnb-4bit

Text Generation • 0.5B • Updated Jan 24, 2025 • 3

sizhkhy/Qwen2.5-0.5B-Instruct-GPTQ-Int4

Text Generation • 0.5B • Updated Nov 18, 2024 • 4

ystemsrx/Qwen2.5-Interpreter

Text Generation • 0.5B • Updated Jan 18, 2025 • 54 • • 2

cgus/Qwen2.5-0.5B-Instruct-exl2

Text Generation • Updated Apr 28, 2025 • 8 • 1

apto-as/Qwen2.5-0.5B-Instruct-Q8_0-GGUF

Text Generation • 0.5B • Updated Nov 28, 2024 • 19

OPEA/Qwen2.5-0.5B-Instruct-int4-sym-inc

0.2B • Updated Sep 11, 2025 • 27.3k

nyuuzyou/Qwen2.5-0.5B-Bluesky-Instruct

Text Generation • 0.5B • Updated Apr 28, 2025 • 4 • 3

Alcoft/Qwen2.5-0.5B-Instruct-GGUF

Text Generation • 0.5B • Updated Apr 29, 2025 • 114

TheBlueObserver/Qwen2.5-0.5B-Instruct-MLX-0cb1b

Text Generation • 46.4M • Updated Dec 17, 2024 • 20

TheBlueObserver/Qwen2.5-0.5B-Instruct-MLX-104ce

Text Generation • 61.8M • Updated Dec 18, 2024 • 16

TheBlueObserver/Qwen2.5-0.5B-Instruct-MLX-196c8

Text Generation • 77.3M • Updated Dec 18, 2024 • 13

TheBlueObserver/Qwen2.5-0.5B-Instruct-MLX-8777b

Text Generation • 0.1B • Updated Dec 18, 2024 • 18

TheBlueObserver/Qwen2.5-0.5B-Instruct-MLX-393a7

Text Generation • 0.1B • Updated Dec 18, 2024 • 14

reach-vb/Qwen2.5-0.5B-Instruct-Q3-mlx

Text Generation • 61.8M • Updated Dec 24, 2024 • 23