Edit Models filters

Model Tree

Qwen/Qwen2.5-0.5B-Instruct

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

253

Base only

Active filters: Qwen/Qwen2.5-0.5B-Instruct

medmekk/Qwen2.5-0.5B-Instruct-2

Text Generation • 0.5B • Updated Mar 18, 2025 • 3

bnb-community/Qwen2.5-0.5B-Instruct-bnb-4bit

Text Generation • 0.5B • Updated Mar 20, 2025 • 6

zhywyt/Qwen2.5-0.5B-Instruct-IQ4_NL-GGUF

Text Generation • 0.5B • Updated Mar 20, 2025 • 3

zhywyt/Qwen2.5-0.5B-Instruct-Q8_0-GGUF

Text Generation • 0.5B • Updated Mar 20, 2025 • 9

medmekk/Qwen2.5-0.5B-Instruct-ao-int8wo-gs128

Text Generation • Updated Mar 31, 2025 • 7

medmekk/Qwen2.5-0.5B-Instruct-ao-int8da8w

Text Generation • Updated Mar 31, 2025 • 6

Lykegenes/Qwen2.5-0.5B-Instruct-mlx-4Bit

Text Generation • 77.3M • Updated Apr 3, 2025 • 10

enacimie/Qwen2.5-0.5B-Instruct-Q4_K_M-GGUF

Text Generation • 0.5B • Updated Apr 15, 2025 • 3

JohnConnor123/Qwen2.5-0.5B-Instruct-GPTQ-8bit

Text Generation • 0.5B • Updated Apr 28, 2025 • 7

JohnConnor123/Qwen2.5-0.5B-Instruct-Q6_K

0.5B • Updated Apr 30, 2025 • 12

JohnConnor123/Qwen2.5-0.5B-Instruct-Q5_K_M

0.5B • Updated Apr 20, 2025 • 6

JohnConnor123/Qwen2.5-0.5B-Instruct-Q4_0

Text Generation • 0.5B • Updated Apr 28, 2025 • 13

medmekk/Qwen2.5-0.5B-Instruct-ao-float8wo

Text Generation • Updated Apr 22, 2025 • 6

Brianpuz/Qwen2.5-0.5B-Instruct-GGUF

Text Generation • 0.5B • Updated May 16, 2025 • 58

JohnConnor123/Qwen2.5-0.5B-Instruct-Q8_0

0.5B • Updated Apr 30, 2025 • 29

JohnConnor123/Qwen2.5-0.5B-Instruct-GPTQ-4bit

0.5B • Updated May 1, 2025 • 5

JohnConnor123/Qwen2.5-0.5B-Instruct-AWQ-64G-INT4-vGEMM

Text Generation • 0.5B • Updated Apr 28, 2025 • 4

JohnConnor123/Qwen2.5-0.5B-Instruct-BNB-8bit

Text Generation • 0.5B • Updated Apr 28, 2025 • 6

JohnConnor123/Qwen2.5-0.5B-Instruct-Q4_K_M

Text Generation • 0.5B • Updated Apr 28, 2025 • 7

nikhilkeetha/Qwen2.5-0.5B-Instruct-Q4_K_M-GGUF

Text Generation • 0.5B • Updated May 2, 2025

eggbiscuit/Qwen2.5-0.5B-Distilled-from-1.5B-AlpacaChinese-v1

0.5B • Updated May 16, 2025 • 21

BennyWang/Qwen2.5-0.5B-Instruct-cl-24233news-5stg-v4-lr_adj-q4f16_1-MLC

Updated Jun 4, 2025

jason-jiao/Qwen2.5-0.5B-Instruct-Q4_K_M-GGUF

Text Generation • 0.5B • Updated May 30, 2025 • 1

jason-jiao/Qwen2.5-0.5B-Instruct-Q4_K_S-GGUF

Text Generation • 0.5B • Updated May 30, 2025 • 1

segopecelus/e595c87a-4acf-47bd-be3d-b703619b7f97

Text Generation • Updated Jun 20, 2025 • 4

xiaoyao9184/Qwen2.5-0.5B-Instruct-onnx-genai

Updated Jul 13, 2025

msens/Qwen2.5-0.5B-Instruct-GGUF

Text Generation • 0.5B • Updated Mar 26, 2025 • 6

AmpereComputing/qwen-2.5-0.5b-instruct-gguf

0.5B • Updated Jul 22, 2025 • 2

Mungert/limbic-tool-use-0.5B-32K-GGUF

0.5B • Updated Sep 24, 2025 • 45

LiyuanLucasLiu/Qwen2.5-0.5B-Instruct-quantized.w8a8-RedHatAI

Text Generation • 0.6B • Updated Aug 4, 2025 • 10