Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

arxiv: 2407.10671

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,513

Base only

Active filters: 2407.10671

TitanML/Qwen2-Math-7B-Instruct

Text Generation • 8B • Updated Sep 11, 2024 • 5

ejiaf/qwen_math_int8_1.5B

Text Generation • 2B • Updated Sep 12, 2024 • 4

Qwen/Qwen2.5-14B

Text Generation • 15B • Updated Sep 20, 2024 • 94.9k • • 156

Qwen/Qwen2.5-32B

Text Generation • 33B • Updated Sep 20, 2024 • 47.1k • • 179

Qwen/Qwen2.5-72B

Text Generation • 73B • Updated Sep 25, 2024 • 33.5k • 102

Qwen/Qwen2.5-Coder-7B

Text Generation • 8B • Updated Nov 18, 2024 • 1.05M • • 159

Qwen/Qwen2.5-32B-Instruct

Text Generation • 33B • Updated Sep 25, 2024 • 1.69M • • 355

erax-ai/EraX-VL-7B-V1.0

Image-Text-to-Text • 8B • Updated Jan 15, 2025 • 43 • 44

Qwen/Qwen2-Math-RM-72B

Text Classification • 73B • Updated Sep 18, 2024 • 59 • 7

Qwen/Qwen2.5-0.5B-Instruct-GPTQ-Int4

Text Generation • 0.5B • Updated Sep 19, 2024 • 1.71k • 9

Qwen/Qwen2.5-0.5B-Instruct-GPTQ-Int8

Text Generation • 0.5B • Updated Oct 9, 2024 • 569 • 10

Qwen/Qwen2.5-1.5B-Instruct-GPTQ-Int4

Text Generation • 2B • Updated Oct 9, 2024 • 6.35k • 3

Qwen/Qwen2.5-1.5B-Instruct-GPTQ-Int8

Text Generation • 2B • Updated Oct 9, 2024 • 1.03k • 6

Qwen/Qwen2.5-3B-Instruct-GPTQ-Int4

Text Generation • 3B • Updated Oct 9, 2024 • 5.47k • 2

Qwen/Qwen2.5-3B-Instruct-GPTQ-Int8

Text Generation • 3B • Updated Oct 9, 2024 • 755 • 3

Qwen/Qwen2.5-7B-Instruct-GPTQ-Int4

Text Generation • 8B • Updated Oct 18, 2024 • 285k • 32

Qwen/Qwen2.5-7B-Instruct-GPTQ-Int8

Text Generation • 8B • Updated Oct 18, 2024 • 3.09k • 18

Qwen/Qwen2.5-14B-Instruct-GPTQ-Int4

Text Generation • 15B • Updated Oct 9, 2024 • 45.1k • 27

Qwen/Qwen2.5-14B-Instruct-GPTQ-Int8

Text Generation • 15B • Updated Oct 9, 2024 • 1.79k • 26

Qwen/Qwen2.5-32B-Instruct-GPTQ-Int4

Text Generation • 33B • Updated Oct 9, 2024 • 472k • 40

Qwen/Qwen2.5-32B-Instruct-GPTQ-Int8

Text Generation • 33B • Updated Oct 9, 2024 • 122k • 14

Qwen/Qwen2.5-72B-Instruct-GPTQ-Int4

Text Generation • 73B • Updated Oct 9, 2024 • 19.5k • 44

Qwen/Qwen2.5-72B-Instruct-GPTQ-Int8

Text Generation • 73B • Updated Oct 9, 2024 • 2.23k • 28

Qwen/Qwen2.5-0.5B-Instruct-AWQ

Text Generation • 0.6B • Updated Oct 9, 2024 • 29k • 11

Qwen/Qwen2.5-1.5B-Instruct-AWQ

Text Generation • 2B • Updated Oct 9, 2024 • 873k • 7

Qwen/Qwen2.5-3B-Instruct-AWQ

Text Generation • 3B • Updated Oct 9, 2024 • 144k • 16

Qwen/Qwen2.5-14B-Instruct-AWQ

Text Generation • 15B • Updated Oct 9, 2024 • 2.3M • 37

Qwen/Qwen2.5-32B-Instruct-AWQ

Text Generation • 33B • Updated Oct 9, 2024 • 736k • 102

Qwen/Qwen2.5-72B-Instruct-AWQ

Text Generation • 73B • Updated Oct 9, 2024 • 1.3M • 78

Qwen/Qwen2.5-32B-Instruct-GGUF

Text Generation • 33B • Updated Sep 20, 2024 • 4.81k • 45