Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

5,639

Base only

Active filters: llama.cpp

yeonseok-zeticai/QWEN_2.5_omni_decoder

8B • Updated Mar 27 • 9

LucasjsBatista/qwen_finetune

4B • Updated Mar 27 • 8

kumarsarthak98/medical-llama-3.2-3b-sft-dpo

3B • Updated Mar 28 • 3

sinanelms/Qwen2.5-7B-Instruct-Turkish-Legal-DoRA-GGUF

8B • Updated Mar 27 • 36

ryancook/chromadb-context-1-gguf

Text Generation • 21B • Updated Mar 28 • 286 • 6

l-lyubenov/qwen-invariants-v1-1-q4km

8B • Updated Mar 28 • 3 • 1

z4iXsECHS6ND-heighTSAI-INSEGCSyX6T-SYS-ROD/LFM2.5-1.2B-Thinking-GGUF

Text Generation • 1B • Updated Mar 28 • 51

HillPhelmuth/gpt-oss-20b-chess-bad

21B • Updated Mar 28 • 27

nicolasembleton/context-1-GGUF

Text Generation • 21B • Updated Mar 28 • 514 • 2

mradermacher/Polaris-VGA-9B-Post1.0e-i1-GGUF

Object Detection • 9B • Updated Apr 21 • 229 • 2

mradermacher/Polaris-VGA-27B-Post1.0e-i1-GGUF

Object Detection • 27B • Updated Apr 21 • 330

timesprimeaj/vendorcenter-assistant-qwen25-gguf

Text Generation • 3B • Updated Apr 3 • 13

OsakanaTeishoku/Qwen3-4B-Thinking-2507-reasoning-ja-20260328-GGUF

4B • Updated Mar 28 • 29

Ishymoto/qwen2.5-0.5b-codey-planner-gguf

0.5B • Updated Mar 28 • 56

kamel-sa/deepseek-distill-q4

8B • Updated Mar 28 • 4 • 1

ragav4075/qwen3-4b-payments

4B • Updated Mar 28 • 18

beleata74/BgGPT-Gemma-3-27B-IT-GGUF-Q4_K_M-mmproj

Image-Text-to-Text • 27B • Updated Mar 30 • 61

prithivMLmods/Qwen3.5-9B-abliterated-v2-MAX

Image-Text-to-Text • 9B • Updated 14 days ago • 634 • 7

prithivMLmods/Qwen3.5-27B-abliterated-v2-MAX

Image-Text-to-Text • 27B • Updated 14 days ago • 138 • 2

jerrycheng233/model5_sft_16bit_gguf

30B • Updated Mar 28 • 16

Lolol857/goonv3

8B • Updated Mar 28 • 69

SanudaDev/SinLlama-GGUF

Text Generation • 8B • Updated Mar 28 • 25

npahwa/ner-json-qwen-q8_0-gguf

2B • Updated Mar 28 • 1

Losa10/Qwen3-0.6b-test-kimi-GGUF

0.6B • Updated Apr 2 • 170

triplepeanut/llama_finetune

1B • Updated Apr 7 • 2

zed344/plant-disease-bot

8B • Updated Mar 29 • 14

limegreenpeper1/Qwen3-4B-Novel-JP-GGUF

4B • Updated Mar 29 • 57

OsakanaTeishoku/Qwen3-4B-Thinking-2507-reasoning-ja-20260329-GGUF

4B • Updated Mar 29 • 38

EREN121232/THUNDER-AI-GGUF

2B • Updated Apr 16 • 16 • 1

daredevil467/qwen3-4b-hanoi-weather-router-v2

4B • Updated Mar 29 • 1