Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

arxiv: 2407.10671

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,514

Base only

Active filters: 2407.10671

Qwen/Qwen2.5-Coder-7B-Instruct-GGUF

Text Generation • 8B • Updated Nov 12, 2024 • 201k • 358

Qwen/Qwen2.5-7B-Instruct

Text Generation • 8B • Updated Jan 12, 2025 • 12.2M • • 1.45k

Qwen/Qwen2.5-0.5B-Instruct

Text Generation • 0.5B • Updated Sep 25, 2024 • 5.64M • • 572

Qwen/Qwen2.5-3B-Instruct-GGUF

Text Generation • 3B • Updated Sep 20, 2024 • 191k • 156

Qwen/Qwen2.5-Coder-14B-Instruct-GGUF

Text Generation • 15B • Updated Nov 12, 2024 • 75.7k • 176

Qwen/Qwen2.5-1.5B-Instruct-GGUF

Text Generation • 2B • Updated Sep 20, 2024 • 211k • 137

Qwen/Qwen2.5-Coder-14B-Instruct

Text Generation • 15B • Updated Jan 12, 2025 • 2.99M • • 178

Qwen/Qwen2.5-0.5B

Text Generation • 0.5B • Updated Sep 25, 2024 • 2.63M • • 433

Qwen/Qwen2.5-14B-Instruct

Text Generation • 15B • Updated Sep 25, 2024 • 3.42M • • 356

Qwen/Qwen2.5-72B-Instruct

Text Generation • 73B • Updated Jan 12, 2025 • 501k • • 967

Qwen/Qwen2.5-Coder-7B-Instruct

Text Generation • 8B • Updated Jan 12, 2025 • 2.01M • • 765

Qwen/Qwen2.5-0.5B-Instruct-GGUF

Text Generation • 0.6B • Updated Sep 20, 2024 • 172k • 116

Qwen/Qwen2.5-7B-Instruct-GGUF

Text Generation • 8B • Updated Sep 20, 2024 • 84.5k • 170

unsloth/Qwen2.5-0.5B-Instruct-unsloth-bnb-4bit

Text Generation • 0.5B • Updated Feb 6, 2025 • 38.3k • 6

Qwen/Qwen2.5-1.5B

Text Generation • 2B • Updated Oct 8, 2024 • 835k • • 201

Qwen/Qwen2.5-3B

Text Generation • 3B • Updated Sep 20, 2024 • 302k • • 200

Qwen/Qwen2.5-7B

Text Generation • 8B • Updated Sep 25, 2024 • 902k • • 301

Qwen/Qwen2.5-7B-Instruct-AWQ

Text Generation • 8B • Updated Oct 9, 2024 • 4.64M • 49

Qwen/Qwen2.5-14B-Instruct-GGUF

Text Generation • 15B • Updated Sep 20, 2024 • 33.3k • 63

Qwen/Qwen2.5-72B-Instruct-GGUF

Text Generation • 73B • Updated Sep 20, 2024 • 3.13k • 46

Qwen/Qwen2.5-3B-Instruct

Text Generation • 3B • Updated Sep 25, 2024 • 5.75M • • 544

Qwen/Qwen2.5-1.5B-Instruct

Text Generation • 2B • Updated Sep 25, 2024 • 14.1M • • 786

Qwen/Qwen2.5-Coder-1.5B-Instruct-GGUF

Text Generation • 2B • Updated Nov 12, 2024 • 72.1k • 79

unsloth/Qwen2.5-Coder-7B-bnb-4bit

Text Generation • 8B • Updated Nov 12, 2024 • 4.99k • 18

Qwen/Qwen2.5-Coder-0.5B-Instruct

Text Generation • 0.5B • Updated Nov 18, 2024 • 96.7k • • 74

Qwen/Qwen2.5-Coder-32B-Instruct

Text Generation • 33B • Updated Jan 12, 2025 • 1.2M • • 2.09k

Qwen/Qwen2.5-Coder-3B

Text Generation • 3B • Updated Nov 18, 2024 • 35.6k • • 57

Qwen/Qwen2.5-Coder-32B-Instruct-AWQ

Text Generation • 33B • Updated Nov 18, 2024 • 1.78M • 38

Qwen/Qwen2.5-Coder-32B-Instruct-GGUF

Text Generation • 33B • Updated Jan 12, 2025 • 215k • 219

Qwen/Qwen2.5-Coder-0.5B-Instruct-GGUF

Text Generation • 0.6B • Updated Nov 11, 2024 • 14.4k • 25