Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

313

Base only

Active filters: turboquant

lew96123/qwen3.5-0.8b-custom-packed-2bit

Image-Text-to-Text • Updated Apr 6 • 8

lew96123/qwen3.5-0.8b-custom-packed-1bit

Image-Text-to-Text • Updated Apr 6 • 12 • 1

deadbydawn101/gemma-4-21b-REAP-Tool-Calling-mlx-4bit

Image-Text-to-Text • 4B • Updated Apr 9 • 300 • 4

deadbydawn101/gemma-4-E4B-Agentic-Opus-Reasoning-GeminiCLI-mlx-4bit

Text Generation • Updated 7 days ago • 157k • 31

apothic/bonsai-8B-1bit-turboquant

8B • Updated Apr 5 • 208 • 5

majentik/gemma-4-E4B-turboquant

Image-Text-to-Text • 8B • Updated 11 days ago • 74 • 8

varjosoft/gemma-4-26B-A4B-it-TQ3

Text Generation • 26B • Updated Apr 7 • 9 • 3

varjosoft/gemma-4-26B-A4B-it-TQ3-native

Text Generation • 11B • Updated Apr 7 • 122 • 2

thetom-ai/Qwen3.5-35B-A3B-TQPlus

Text Generation • 35B • Updated Apr 8 • 38 • 2

thetom-ai/Gemma-4-31B-it-TQPlus

Text Generation • 31B • Updated Apr 8 • 16 • 2

manjunathshiva/gpt-oss-20b-tq3

Text Generation • 22B • Updated 16 days ago • 1.64k • 46

thetom-ai/Meta-Llama-3.1-70B-Instruct-TQPlus

Text Generation • Updated Apr 8

atomicmilkshake/llama-cpp-turboquant-binaries

Updated Apr 8 • 12

varjosoft/GLM-5.1-Open-TQ3

Text Generation • 289B • Updated Apr 9 • 9 • 2

nwzjk/GLM-5.1-Open-TQ3

Text Generation • 289B • Updated Apr 9 • 11 • 2

varjosoft/GLM-4.7-Flash-TQ3

13B • Updated Apr 9 • 9 • 1

YTan2000/Qwopus3.5-27B-v3-Abliterated-TQ3_4S

Text Generation • 27B • Updated Apr 23 • 70 • 7

Jonatan-1987-xtv/gemma-4-e2b-turboquant-standard-int4

Image-Text-to-Text • 4B • Updated Apr 10 • 7

Jonatan-1987-xtv/gemma-4-e2b-turboquant-atq3

Image-Text-to-Text • 4B • Updated Apr 10 • 6

Jonatan-1987-xtv/gemma-4-e2b-turboquant-tql-4b

Image-Text-to-Text • 4B • Updated Apr 10 • 5

Jonatan-1987-xtv/gemma-4-e2b-turboquant-tql-3b

Image-Text-to-Text • 4B • Updated Apr 10 • 4

Jonatan-1987-xtv/gemma-4-e4b-turboquant-standard-int4

Image-Text-to-Text • 7B • Updated Apr 10 • 4

Jonatan-1987-xtv/gemma-4-e4b-turboquant-atq3

Image-Text-to-Text • 7B • Updated Apr 10 • 5

Jonatan-1987-xtv/gemma-4-e4b-turboquant-tql-4b

Image-Text-to-Text • 7B • Updated Apr 10 • 5

Jonatan-1987-xtv/gemma-4-e4b-turboquant-tql-3b

Image-Text-to-Text • 7B • Updated Apr 10 • 6 • 2

fno2010/MiniMax-M2.7-TQ3

88B • Updated Apr 12 • 22 • 14

majentik/Qwen3.5-27B-TurboQuant-MLX-4bit

Text Generation • 27B • Updated 11 days ago • 249 • 2

majentik/Qwen3.5-27B-TurboQuant-MLX-8bit

Text Generation • 27B • Updated 11 days ago • 150

majentik/Qwen3.5-27B-TurboQuant-MLX-2bit

Text Generation • 27B • Updated 11 days ago • 323

majentik/Mistral-Small-4-119B-TurboQuant-MLX-4bit

Text Generation • 19B • Updated 11 days ago • 402