Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

381

Base only

Active filters: q4_k_m

nerkyor/Lynn-V4-Pro-Distill-Qwen-35B-A3B-Q4_K_M

Text Generation • 35B • Updated about 1 month ago • 145

ree2raz/CyberSecQwen-4B-GGUF

4B • Updated May 13 • 72 • 1

HackerTwins/NVIDIA-Nemotron-Labs-3-Elastic-23B-A2.8B-GGUF

Text Generation • 24B • Updated May 14 • 349 • 2

HackerTwins/NVIDIA-Nemotron-Labs-3-Elastic-12B-A2B-GGUF

Text Generation • 12B • Updated May 14 • 406 • 2

nerkyor/Lynn-V4-Flash-Distill-Qwen-35B-A3B-Q4_K_M

Text Generation • 35B • Updated about 1 month ago • 165

JeffGreen311/eve-qwen35-4b-solforg3

Text Generation • 5B • Updated 25 days ago • 357

tsilva/qwen2.5-3b-trump-style-gguf-v3

3B • Updated about 1 month ago • 44

thinktecture/gemma3-4b-ft-nextera-q4_k_m

Text Generation • 4B • Updated about 1 month ago • 22

nerkyor/Qwen3.6-35B-A3B-GGUF-imatrix

Text Generation • Updated 27 days ago • 335

madhuHuggingface/functiongemma-vpc-gguf

0.3B • Updated 24 days ago • 398 • 2

YuYu1015/Huihui-Qwen3.6-27B-abliterated-UD-Q4_K_XL-MTP-GGUF

Text Generation • 27B • Updated 29 days ago • 1.15k • 2

nswitzer/gemma4-maritime-medical-GGUF

5B • Updated 29 days ago • 461

meghanamakkapati/Gemma-4_quantization

Image-to-Text • 8B • Updated 26 days ago • 83

Serjio42/gemma4-e2b-finetuned-caregivers

Text Generation • 5B • Updated 29 days ago • 28

OpenYourMind/Qwopus3.5-122B-A10B-Kimi-K2.6-destill-healed-abliterated-GGUF

Image-Text-to-Text • 125B • Updated about 9 hours ago • 2.2k • 2

nerkyor/Qwen3.5-9B-GGUF-imatrix

Text Generation • Updated 24 days ago • 291

ankur1423/fine-tune-test-2

Text Generation • 8B • Updated 26 days ago • 9

ProToni/triagellm-qwen3-1.7b-gguf

2B • Updated 12 days ago • 1 • 1

rectx/Qwen3.5-9B-GGUF

9B • Updated 25 days ago • 240

tristiyadi/kafi-barista-llama3.2-1b-gguf

Text Generation • 1B • Updated 25 days ago • 226

zaydiscold/Qwopus3.6-27B-v2-Q4_K_M-GGUF

27B • Updated 25 days ago • 241

nerkyor/Qwen3-4B-Thinking-2507-GGUF-imatrix

Text Generation • Updated 25 days ago • 232

nerkyor/Qwen3.5-4B-GGUF-imatrix

Text Generation • Updated 24 days ago • 179

hung2903/gemma-4-E4B-vaccine-xai-merged

Text Generation • 8B • Updated 21 days ago • 217

mkadrlik/hermes-Qwen3.6-27B-FT-Q8_0

27B • Updated 23 days ago • 104

fraQtl/Qwen3.6-35B-A3B-Hi-Fi-GGUF

Text Generation • 35B • Updated 17 days ago • 594 • 3

Guohao1020/voc-tagger-7b-v3

Text Classification • 8B • Updated 22 days ago • 125

osmapi/osmQwopus-3.6-27B-V2-heretic-abliterated-uncensored-Q4_K_M-GGUF

Image-Text-to-Text • 27B • Updated 15 days ago • 1.05k • 1

rotextechnologiesuk/nuclear-sqep

Text Generation • 8B • Updated 21 days ago • 39

Drissman/hermythos-rdt

Text Generation • 8B • Updated 21 days ago • 69 • 1