Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

weight-quantization

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

14

Base only

Active filters: weight-quantization

AEON-7/Gemma-4-26B-A4B-it-Uncensored-NVFP4

Text Generation • 15B • Updated 1 day ago • 8.75k • 20

AEON-7/Gemma-4-31B-it-DECKARD-HERETIC-Uncensored-NVFP4

Text Generation • 18B • Updated 15 days ago • 2.11k • 11

majentik/Qwen3.5-397B-A17B-TurboQuant-MLX-8bit

Image-Text-to-Text • 112B • Updated Apr 16 • 61 • 1

osmapi/sarvam-30b-TQ3_1S-GGUF

Text Generation • Updated Apr 2 • 7 • 2

AEON-7/Gemma-4-31B-it-DECKARD-HERETIC-Uncensored-NVFP4-SVDQuant

Text Generation • 19B • Updated 15 days ago • 405 • 2

majentik/Leanstral-TurboQuant-MLX-2bit

23B • Updated May 6 • 51

majentik/Leanstral-RotorQuant-MLX-2bit

23B • Updated May 6 • 40

majentik/Leanstral-TurboQuant-MLX-8bit

Text Generation • 34B • Updated May 6 • 50

majentik/Leanstral-RotorQuant-MLX-8bit

Text Generation • 34B • Updated May 6 • 34

AEON-7/supergemma4-26b-abliterated-multimodal-nvfp4

Text Generation • 15B • Updated 15 days ago • 161 • 4

majentik/Qwen3.5-397B-A17B-TurboQuant-MLX-4bit

Image-Text-to-Text • 62B • Updated Apr 16 • 75

majentik/Qwen3.5-397B-A17B-TurboQuant-MLX-2bit

Image-Text-to-Text • 38B • Updated Apr 16 • 72

majentik/Qwen3.5-397B-A17B-RotorQuant-MLX-2bit

Image-Text-to-Text • 38B • Updated Apr 16 • 62

majentik/Qwen3.5-397B-A17B-RotorQuant-MLX-8bit

Image-Text-to-Text • 112B • Updated Apr 16 • 61