Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

46,823

Base only

Active filters: 4-bit

antirez/deepseek-v4-gguf

Text Generation • 284B • Updated May 31 • 6.41M • 307

Nguuma/security-slm-unsloth-1.5b

Text Generation • 2B • Updated May 7 • 355 • 31

AEON-7/Ornith-1.0-35B-AEON-Ultimate-Uncensored-NVFP4

Text Generation • 21B • Updated 8 days ago • 17.5k • 44

huihui-ai/Huihui-DeepSeek-V4-Flash-abliterated-ds4-GGUF

284B • Updated 30 days ago • 585k • 92

mlx-community/gemma-4-12b-coder-fable5-composer2.5-4bit

Text Generation • 12B • Updated 15 days ago • 6.01k • 16

wang-yang/Ornith-1.0-35B-MTPLX

Text Generation • 35B • Updated 6 days ago • 7.74k • 12

mlx-community/Qwen3.5-9B-MLX-4bit

Image-Text-to-Text • 2B • Updated Mar 23 • 19.8k • 140

mlx-community/Qwen3.6-27B-4bit

Image-Text-to-Text • 5B • Updated Apr 22 • 21.2k • 42

mlx-community/Qwen3.6-27B-OptiQ-4bit

Text Generation • 27B • Updated 17 days ago • 13.2k • 58

mlx-community/Ornith-1.0-35B-4bit

Image-Text-to-Text • 6B • Updated 9 days ago • 4.44k • 7

wang-yang/Agents-A1-MTPLX-Q4

Text Generation • 35B • Updated 2 days ago • 568 • 6

mlx-community/Qwen3.5-9B-OptiQ-4bit

Text Generation • 9B • Updated 17 days ago • 14.3k • 74

mlx-community/Qwen3.6-35B-A3B-4bit

Image-Text-to-Text • 6B • Updated Apr 16 • 36.7k • 81

Jiunsong/SuperQwen-AgentWorld-35B-A3B-abliterated-gguf-4bit

Text Generation • 35B • Updated 11 days ago • 3.7k • 8

mlx-community/Qwen-AgentWorld-35B-A3B-oQ4

Text Generation • 6B • Updated 9 days ago • 823 • 5

unsloth/Qwen3.6-35B-A3B-UD-MLX-4bit

Image-Text-to-Text • 6B • Updated Apr 20 • 22.4k • 101

Youssofal/Qwen3.6-27B-MTPLX-Optimized-Speed

Text Generation • 5B • Updated 30 days ago • 21.2k • 54

sahilchachra/Qwythos-9B-Claude-Mythos-5-1M-optiq-5bpw-mlx

9B • Updated 12 days ago • 2.7k • 5

Jiunsong/SuperQwen-AgentWorld-35B-A3B-abliterated-mlx-4bit

Text Generation • 35B • Updated 11 days ago • 706 • 6

mlx-community/Ornith-1.0-9B-4bit

Text Generation • 2B • Updated 9 days ago • 8.51k • 5

mlx-community/Agents-A1-4bit

Image-Text-to-Text • 6B • Updated 5 days ago • 735 • 4

mlx-community/Qwen3.5-27B-Claude-4.6-Opus-Distilled-MLX-4bit

27B • Updated Mar 6 • 20.2k • 229

saricles/MiniMax-M2.7-REAP-172B-A10B-NVFP4-GB10

Text Generation • 87B • Updated Apr 19 • 4.65k • 32

unsloth/Qwen3.6-27B-UD-MLX-4bit

Image-Text-to-Text • 10B • Updated Apr 22 • 9.42k • 61

Lorbus/Qwen3.6-27B-int4-AutoRound

Image-Text-to-Text • 6B • Updated Apr 22 • 811k • 120

Intel/Qwen3.6-27B-int4-AutoRound

6B • Updated May 21 • 437k • 41

mlx-community/Qwen3.6-35B-A3B-OptiQ-4bit

Text Generation • 35B • Updated 17 days ago • 15.2k • 43

AlicanKiraz0/Titus-CybersecurityLLM-v1.0-mlx-4Bit

Text Generation • 35B • Updated May 27 • 840 • 38

mlx-community/gemma-4-12B-it-qat-4bit

Image-Text-to-Text • 3B • Updated about 1 month ago • 24.1k • 20

philipjohnbasile/GLM-5.2-Demolition-q4a4-soul-MLX

Text Generation • 29B • Updated 14 days ago • 4.89k • 6