Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3

Base only

Active filters: q3_k

Edmon02/deepseek-coder-7b-instruct-v1.5-GGUF

Text Generation • 7B • Updated 11 days ago • 355

tifin-india/sarvam-m-24b-q3-k-gguf

Text Generation • 24B • Updated May 24, 2025 • 4

glyphsoftware/gemma-4-26b-a4b-opus-4.7-distilled-gguf

Text Generation • 25B • Updated 16 days ago • 613