Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

20,959

Base only

Active filters: gguf-my-repo

AlicanKiraz0/Cybersecurity-BaronLLM_Offensive_Security_LLM_Q6_K_GGUF

Text Generation • 8B • Updated Jun 4, 2025 • 964 • 276

HuggingFaceTB/SmolLM2-1.7B-Instruct-GGUF

Text Generation • 2B • Updated Nov 5, 2024 • 16.5k • 51

huihui-ai/BaronLLM_Offensive_Security-abliterated-GGUF

Text Generation • 8B • Updated Jun 11, 2025 • 434 • 52

mitkox/antares-1b-Q8_0-GGUF

Text Generation • 2B • Updated 11 days ago • 3.74k • 27

sugatoray/DeepSeek-Coder-V2-Lite-Instruct-Q4_K_M-GGUF

16B • Updated Jun 23, 2024 • 1.21k • 3

kxdw2580/Qwen2.5-3B-Instruct-Uncensored-Test-Q8_0-GGUF

3B • Updated Nov 9, 2024 • 249 • 1

HuggingFaceTB/SmolLM2-360M-Instruct-GGUF

0.4B • Updated Oct 31, 2024 • 9.95k • 51

itlwas/magnum-v2-12b-Q4_K_M-GGUF

Text Generation • 12B • Updated Dec 18, 2024 • 585 • 1

itlwas/DeepSeek-R1-Distill-Qwen-7B-Q4_K_M-GGUF

8B • Updated Jan 25, 2025 • 37 • 1

jfiekdjdk/Qwen3-8B-abliterated-Q5_K_M-GGUF

Text Generation • 8B • Updated Apr 30, 2025 • 353 • 1

zenyr/mxbai-embed-large-v1-Q4_K_M-GGUF

Feature Extraction • 0.3B • Updated Jun 16, 2025 • 6 • 1

maerong3/Huihui-Mistral-Small-3.2-24B-Instruct-2506-abliterated-Q4_K_M-GGUF

Image-Text-to-Text • 24B • Updated Aug 6, 2025 • 454 • 3

dcv21/Huihui-Qwen3-8B-abliterated-v2-Q4_K_M-GGUF

Text Generation • 8B • Updated Sep 23, 2025 • 284 • 3

ggml-org/Qwen3-Reranker-0.6B-Q8_0-GGUF

Text Ranking • 0.6B • Updated Oct 3, 2025 • 39.9k • 27

ggml-org/bge-m3-Q8_0-GGUF

Sentence Similarity • 0.6B • Updated Oct 12, 2025 • 6.96k • 13

mrgoldengun/Qwen3-4B-Q2_K-GGUF

Text Generation • 4B • Updated Oct 29, 2025 • 15 • 1

KathAhegao/Qwen3-VL-4B-Instruct-Q2_K-GGUF

Image-Text-to-Text • 4B • Updated Nov 9, 2025 • 31 • 1

bocalan/Qwen2.5-Coder-3B-Instruct-Q4_K_M-GGUF

Text Generation • 3B • Updated Nov 11, 2025 • 5.23k • 1

Edge-Quant/Nanbeige4.1-3B-Q4_K_M-GGUF

Text Generation • 4B • Updated Feb 11 • 2.61k • 39

Tho465/Qwen3-Coder-Next-REAM-AWQ-4bit-Q4_K_M-GGUF

60B • Updated Feb 20 • 221 • 3

sillykiwi/Qwen3-4B-Cybersecurity-Heretic-16bit-Q4_K_M-GGUF

Text Generation • 4B • Updated Apr 3 • 523 • 7

gaoqianshen/Qwen3.6-27B-FP8-Q4_K_M-GGUF

Image-Text-to-Text • Updated Apr 22 • 507 • 2

brunopio/Qwen3.5-14B-A3B-Claude-4.6-Opus-Reasoning-Distilled-reap-Q4_K_M-GGUF

Text Generation • 14B • Updated May 26 • 6.81k • 15

ia-espirita/riv-ai-v2-Q4_K_M-GGUF

Text Generation • 8B • Updated May 10 • 16 • 2

Grapheneos/Assistant_Pepe_32B-Q4_K_M-GGUF

33B • Updated May 4 • 80 • 2

viniciusianni/Mamba-Codestral-7B-v0.1-Q4_K_M-GGUF

7B • Updated Jun 4 • 145 • 1

Kraekin/Goetia-26B-A4B-v1.3-Absolute-Heretic-ARA-Q4_K_M-GGUF

25B • Updated Jun 20 • 173 • 1

sillykiwi/Qwen2.5-Coder-7B-Instruct-Ghidra-v2-Q4_K_M-GGUF

Text Generation • 8B • Updated Jun 30 • 3.58k • 5

Szeweq/G9v3-3B-Q8_0-GGUF

Text Generation • 3B • Updated 10 days ago • 907 • 2

HolkViking/antares-1b-Q4_K_M-GGUF

Text Generation • 2B • Updated 9 days ago • 270 • 1