Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

45

Base only

Active filters: rdna4

xzanomad/Qwen3.6-27B-Fable-Fusion-711-FP8

Image-Text-to-Text • 28B • Updated 5 days ago • 2.97k • 8

1337Hero/KAT-Coder-V2.5-Dev-ROCMFP4-GGUF

Text Generation • 35B • Updated about 1 hour ago • 1

JohnTdi/Qwen3-14B-INT4-Mixed-GPTQ

Text Generation • Updated Mar 11

JohnTdi/Qwen3-14B-INT4-Pure-GPTQ

Text Generation • Updated Mar 11

JohnTdi/Qwen3.5-Unsloth-GGUF-R9700-Benchmark

27B • Updated Mar 27 • 22 • 1

djdeniro/Qwen3.5-35B-A3B-MXFP4

Image-Text-to-Text • 20B • Updated Apr 10 • 6 • 1

djdeniro/Qwen3.5-397B-A17B-MXFP4

Image-Text-to-Text • 215B • Updated Apr 11 • 13 • 2

mattbucci/gemma-4-31B-it-AutoRound-AWQ

31B • Updated May 11 • 300

mattbucci/Devstral-24B-AWQ

24B • Updated Apr 29 • 32

mattbucci/Qwen3.5-27B-AWQ

Text Generation • 27B • Updated Apr 29 • 24 • 1

mattbucci/Qwen3-Coder-30B-A3B-AWQ

31B • Updated May 26 • 138

mattbucci/gemma-4-26B-AWQ

26B • Updated May 31 • 17.3k • 1

pahajokiconsulting/Qwen3.6-35B-A3B-MXFP4

Image-Text-to-Text • 20B • Updated Apr 17 • 1.57k • 7

mattbucci/Qwen3.6-35B-A3B-AWQ-CT

35B • Updated Apr 26 • 238 • 2

mattbucci/Qwen3.6-27B-AWQ-CT

27B • Updated Apr 26 • 4.32k • 1

mattbucci/Qwen3.6-27B-AWQ

27B • Updated May 1 • 29k • 5

mattbucci/Qwen3-Coder-REAP-25B-A3B-AWQ

25B • Updated Apr 29 • 938 • 1

mattbucci/Qwen3.6-REAM-A3B-AWQ

Image-Text-to-Text • 27B • Updated May 29 • 252

mattbucci/Qwen3-Coder-30B-A3B-REAM-AWQ

23B • Updated May 9 • 9

mattbucci/gemma-4-31B-AWQ

31B • Updated May 31 • 3.64k

LJTSG/webgpu-for-amd-ai-pcs

Updated Jun 3 • 1

djdeniro/MiniMax-M2.7-MXFP416

Text Generation • 130B • Updated Jun 9 • 36

Capicua25x/Qwen3.6-35B-A3B-DSV4Pro-Thinking-Distill-MXFP4

Text Generation • 35B • Updated Jun 17 • 54

Capicua25x/Qwen3.6-35B-A3B-DSV4Pro-Thinking-Distill-MXFP4-Vision

Image-Text-to-Text • 35B • Updated Jun 17 • 54

Launch80/Qwen3.6_27B-RFP458

Text Generation • 17B • Updated Jun 25 • 56 • 2

maczzinatui/Ornith-1.0-9b-ROCmFPX-STRIX_LEAN-GGUF

9B • Updated Jun 29 • 42

maczzinatui/Qwen3.6-14B-A3B-vibetuned-ROCmFPX-STRIX_LEAN-GGUF

14B • Updated Jun 29 • 652 • 1

maczzinatui/GLM-4.7-Flash-REAP-23B-A3B-ROCmFPX-STRIX_LEAN-GGUF

23B • Updated Jun 29 • 91 • 1

maczzinatui/Ornstein-3.5-9B-V2-ROCmFPX-STRIX_LEAN-GGUF

9B • Updated Jun 29 • 26

Capicua25x/Ornith-1.0-9B-MXFP4-Vision-MTP

Image-Text-to-Text • 10B • Updated 22 days ago • 183 • 2