Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

7,277

Base only

Active filters: GGUF

ponpoke/flux2-klein-9b-uncensored-text-encoder

Text-to-Image • 8B • Updated May 2 • 34.1k • 436

huihui-ai/Huihui-DeepSeek-V4-Flash-0731-abliterated-GGUF

Text Generation • 284B • Updated 20 days ago • 394k • 165

ponpoke/flux2-klein-4b-uncensored-text-encoder

Text-to-Image • 4B • Updated May 2 • 9.82k • 124

deadbydawn101/RavenX-CyberAgent-Qwen3.6-35B-A3B-Opus-4.7-OpenMythos-Pentester-BugHunter-RATH-GGUF

Text Generation • 36B • Updated Jun 13 • 17.4k • 139

huihui-ai/Huihui-GLM-5.2-abliterated-GGUF

Text Generation • 754B • Updated 22 days ago • 26.3k • 340

huihui-ai/Huihui-DeepSeek-V4-Flash-abliterated-ds4-GGUF

284B • Updated Jun 6 • 264k • 130

jashepp/Ornith-1.5-35B-A3B-MXFP4_MOE_Hybrid-Imatrix-GGUF

Text Generation • 35B • Updated about 18 hours ago • 1.15k • 4

RavichandranJ/Dolphin3-Cyber-8B-GGUF

Text Generation • 8B • Updated Jun 8 • 59k • 163

huihui-ai/Huihui-Qwen3.6-35B-A3B-Claude-4.7-Opus-abliterated-MTP-GGUF

Image-Text-to-Text • 36B • Updated May 19 • 77.9k • 105

huihui-ai/Huihui-Qwen3.6-27B-abliterated-MTP-GGUF

Image-Text-to-Text • 27B • Updated May 19 • 64.2k • 96

w-ahmad/Qwen3.5-9B-GGUF-MoQ-MTP

Text Generation • 9B • Updated Jun 4 • 934 • 8

huihui-ai/Huihui-Qwythos-9B-Claude-Mythos-5-1M-abliterated-GGUF

Text Generation • 9B • Updated Jun 25 • 43.3k • 168

CoreWolf/Huihui-DeepSeek-V4-Flash-0731-abliterated-GGUF

Text Generation • 284B • Updated 4 days ago • 1.23k • 2

LiteLLMs/dolphin-2.9-llama3-8b-GGUF

8B • Updated Apr 29, 2024 • 232 • 1

MaziyarPanahi/Yi-Coder-1.5B-Chat-GGUF

Text Generation • 1B • Updated Sep 4, 2024 • 173k • 20

MaziyarPanahi/Yi-Coder-9B-Chat-GGUF

Text Generation • 9B • Updated Sep 4, 2024 • 173k • 9

MaziyarPanahi/Llama-3.2-3B-Instruct-abliterated-GGUF

Text Generation • 4B • Updated Oct 20, 2024 • 3.17k • 3

tensorblock/Yi-Coder-9B-GGUF

Text Generation • 9B • Updated Jan 27 • 16 • 1

tensorblock/Qwen2.5-7B-Instruct-Uncensored-GGUF

Text Generation • 8B • Updated Jan 27 • 1.04k • 8

tensorblock/Llama-3-Taiwan-70B-Instruct-GGUF

Text Generation • 71B • Updated Jan 27 • 128 • 3

MaziyarPanahi/phi-4-GGUF

Text Generation • 15B • Updated Jan 8, 2025 • 173k • 10

tensorblock/r1-1776-GGUF

Updated Jan 27 • 9

MaziyarPanahi/gemma-3-4b-it-GGUF

Text Generation • 4B • Updated Mar 12, 2025 • 181k • 20

DavidAU/Gemma-3-Nine-Rings-of-Power-Fiction-Horror-4b-it-GGUF

Text Generation • 4B • Updated Jul 28, 2025 • 707 • 5

MaziyarPanahi/Qwen3-0.6B-GGUF

Text Generation • 0.8B • Updated Apr 28, 2025 • 293k • 14

MaziyarPanahi/Qwen3-1.7B-GGUF

Text Generation • 2B • Updated Apr 28, 2025 • 288k • 11

MaziyarPanahi/Qwen3-4B-GGUF

Text Generation • 4B • Updated Apr 28, 2025 • 328k • 8

MaziyarPanahi/Qwen3-30B-A3B-GGUF

Text Generation • 31B • Updated Apr 29, 2025 • 283k • 6

tensorblock/unsloth_Phi-4-mini-reasoning-GGUF

Text Generation • 4B • Updated Jan 27 • 48 • 1

huihui-ai/Huihui-Qwen3-VL-235B-A22B-Instruct-abliterated-GGUF

Image-Text-to-Text • 235B • Updated Dec 6, 2025 • 1.28k • 32