Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

23,954

Base only

Active filters: llama-cpp

deadbydawn101/RavenX-CyberAgent-Qwen3.6-35B-A3B-Opus-4.7-OpenMythos-Pentester-BugHunter-RATH-GGUF

Text Generation • 36B • Updated 4 days ago • 6.81k • 44

prithivMLmods/VibeThinker-3B-GGUF

Text Generation • 3B • Updated 1 day ago • 861 • 12

prism-ml/Ternary-Bonsai-8B-gguf

Text Generation • 8B • Updated 7 days ago • 9.85k • 99

barozp/Qwen3.6-28B-REAP20-A3B-GGUF

Text Generation • 28B • Updated Apr 19 • 12.9k • 37

mitkox/FastContext-1.0-4B-SFT-Q4_K_M-GGUF

4B • Updated 2 days ago • 491 • 7

spiritbuun/buun-Qwen3.6-chat_template

Updated 20 days ago • 48

RavichandranJ/Dolphin3-Cyber-8B-GGUF

Text Generation • 8B • Updated 9 days ago • 11.3k • 21

Tesslate/OmniCoder-9B-GGUF

9B • Updated Mar 12 • 12.2k • 309

deadbydawn101/gemma-4-E4B-Agentic-Opus-Reasoning-GeminiCLI-GGUF

Text Generation • 8B • Updated Apr 16 • 4.19k • 19

oussaber/VibeThinker-3B-Q4_K_M-GGUF

Text Generation • 3B • Updated 1 day ago • 425 • 4

prism-ml/Bonsai-8B-gguf

Text Generation • 8B • Updated Apr 18 • 13.2k • 719

prism-ml/Ternary-Bonsai-1.7B-gguf

Text Generation • 2B • Updated 7 days ago • 2.15k • 23

rico03/Qwen3.6-27B-Claude-Opus-Reasoning-Distilled-GGUF

Text Generation • 27B • Updated Apr 23 • 14.9k • 47

prithivMLmods/Holo-3.1-9B-GGUF

Image-Text-to-Text • 9B • Updated 15 days ago • 74.9k • 7

LocalAI-io/privacy-filter-multilingual-GGUF

Token Classification • 1B • Updated 3 days ago • 165 • 3

mitkox/FastContext-1.0-4B-SFT-Q5_K_M-GGUF

4B • Updated 2 days ago • 294 • 3

HuggingFaceTB/SmolLM2-360M-Instruct-GGUF

0.4B • Updated Oct 31, 2024 • 7.89k • 47

prism-ml/Bonsai-4B-gguf

Text Generation • 4B • Updated Apr 18 • 7.09k • 49

prism-ml/Bonsai-1.7B-gguf

Text Generation • 2B • Updated Apr 18 • 8.23k • 76

sillykiwi/Qwen3-4B-Cybersecurity-Heretic-16bit-Q4_K_M-GGUF

Text Generation • 4B • Updated Apr 3 • 485 • 5

prism-ml/Ternary-Bonsai-4B-gguf

Text Generation • 4B • Updated 7 days ago • 1.78k • 17

AtomicChat/Qwen3.6-27B-UDT-MTP-GGUF

27B • Updated May 13 • 2.9k • 9

sneedjak/Adelic-Gemma-4-12B-GGUF

Text Generation • 12B • Updated 10 days ago • 8.46k • 4

ThePradip/minicpm5-1b-kids-storyteller-GGUF

Text Generation • 1B • Updated 3 days ago • 737 • 2

FlameF0X/Apodex-1.0-mini-Q4_K_M-GGUF

Text Generation • 36B • Updated 5 days ago • 217 • 2

JohnRoger/VibeThinker-3B-Q8_0-GGUF

Text Generation • 3B • Updated 1 day ago • 240 • 2

LeroyDyer/Mixtral_AI_Cyber_Dolphin-Q4_K_M-GGUF

7B • Updated Aug 26, 2024 • 29 • 2

RachidAR/ablation-model-fineweb-v1-Q6_K-GGUF

2B • Updated Apr 23, 2024 • 5 • 1

NoelJacob/Meta-Llama-3-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Apr 24, 2024 • 427 • 3

ggml-org/Meta-Llama-3.1-8B-Instruct-Q4_0-GGUF

Text Generation • 8B • Updated Sep 2, 2024 • 6.8k • 15