Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

23,887

Base only

Active filters: llama-cpp

deadbydawn101/RavenX-CyberAgent-Qwen3.6-35B-A3B-Opus-4.7-OpenMythos-Pentester-BugHunter-RATH-GGUF

Text Generation • 36B • Updated about 5 hours ago • 3.82k • 15

RavichandranJ/Dolphin3-Cyber-8B-GGUF

Text Generation • 8B • Updated 5 days ago • 5.19k • 18

spiritbuun/buun-Qwen3.6-chat_template

Updated 16 days ago • 45

prism-ml/Bonsai-8B-gguf

Text Generation • 8B • Updated Apr 18 • 49.5k • 717

prism-ml/Ternary-Bonsai-8B-gguf

Text Generation • 8B • Updated 3 days ago • 8.64k • 95

Tesslate/OmniCoder-9B-GGUF

9B • Updated Mar 12 • 12k • 307

prism-ml/Ternary-Bonsai-1.7B-gguf

Text Generation • 2B • Updated 3 days ago • 1.9k • 22

prism-ml/Ternary-Bonsai-4B-gguf

Text Generation • 4B • Updated 3 days ago • 1.39k • 16

barozp/Qwen3.6-28B-REAP20-A3B-GGUF

Text Generation • 28B • Updated Apr 19 • 8.19k • 31

sillykiwi/Qwen3-4B-Cybersecurity-Heretic-16bit-Q4_K_M-GGUF

Text Generation • 4B • Updated Apr 3 • 211 • 4

stacksnathan/Qwen3-Coder-Next-80B-APEX-I-Quality-GGUF

Text Generation • 80B • Updated Apr 5 • 636 • 10

Abiray/gemma-4-12b-it-GGUF

Any-to-Any • 12B • Updated 9 days ago • 5.24k • 14

pjsmith/Qwen3.6-35B-A3B-2.6763bpw.gguf

35B • Updated 6 days ago • 676 • 3

Tivaphraen/granite-4.1-8b-Claude-Opus-4.6-Thinking-MAX-gguf

Text Generation • 9B • Updated 5 days ago • 472 • 3

EganAI/qwen3.5-9b-terminal-merge

Text Generation • 9B • Updated Mar 17 • 219 • 17

prism-ml/Bonsai-4B-gguf

Text Generation • 4B • Updated Apr 18 • 5.63k • 48

danushman/gemma-4-E4B-it-OBLITERATED-Q4_K_M-GGUF

Text Generation • 7B • Updated Apr 16 • 406 • 3

NidAll/supergemma4-e4b-abliterated-Q4_K_M-GGUF

Text Generation • 8B • Updated Apr 17 • 2.42k • 22

FinnTheAI/Kimi-K2.6-SmartQuant-GGUF

Text Generation • 1T • Updated 5 days ago • 1.26k • 2

nopesadly/higgs-audio-v3-8b-stt-v2-Q4_K_M-GGUF

Automatic Speech Recognition • 8B • Updated 16 days ago • 227 • 2

gaston-parravicini/LFM2.5-8B-A1B-Uncensored-Gaston-GGUF

Text Generation • 8B • Updated 14 days ago • 2.53k • 13

sneedjak/Adelic-Gemma-4-12B-GGUF

Text Generation • 12B • Updated 6 days ago • 21.2k • 3

ijohn07/harness-1-Q4_K_M-GGUF

Text Generation • 21B • Updated 4 days ago • 350 • 2

elyza/Llama-3-ELYZA-JP-8B-GGUF

8B • Updated Jun 26, 2024 • 1.46k • 74

Tech-Meld/Llama3-ChatQA-1.5-8B-Q4_K_S-GGUF

Text Generation • 8B • Updated Jun 30, 2024 • 77 • 2

TheRains/Qwen2.5-14B-Instruct-Q4_K_M-GGUF

Text Generation • 15B • Updated Sep 19, 2024 • 1.8k • 3

hugging-quants/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • 3B • Updated Sep 25, 2024 • 14.3k • 30

ggml-org/Qwen2.5-Coder-7B-Q8_0-GGUF

Text Generation • 8B • Updated Oct 28, 2024 • 1.24k • 10

HuggingFaceTB/SmolLM2-360M-Instruct-GGUF

0.4B • Updated Oct 31, 2024 • 7.26k • 46

Maites/Qwen2.5-Coder-3B-Instruct-Q4_K_M-GGUF

Text Generation • 3B • Updated Nov 26, 2024 • 806 • 1