Edit Models filters

Model Tree

sarvamai/sarvam-30b

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

27

Base only

Active filters: sarvamai/sarvam-30b

Orange/sarvam-30b-gptq-w4a16-targeted

Text Generation • 7B • Updated about 16 hours ago • 435 • 1

abhinand/sarvam-30b-bf16

Text Generation • 32B • Updated Mar 8 • 76 • 3

neuralnets/sarvam-30b-8bit

32B • Updated Mar 10 • 7 • 3

inference-optimization/sarvam-30b-FP8-Dynamic

Text Generation • 32B • Updated Mar 9 • 4 • 1

inference-optimization/sarvam-30b-NVFP4

Text Generation • 19B • Updated Mar 9 • 7 • 1

Sumitc13/sarvam-30b-GGUF

32B • Updated May 9 • 236 • 6

ThatCultivator/sarvam-30b-gguf

Text Generation • 32B • Updated Mar 9 • 4 • 2

RedHatAI/sarvam-30b-FP8-dynamic

Text Generation • 32B • Updated Apr 28 • 91.6k • 1

DevQuasar/sarvamai.sarvam-30b-GGUF

Text Generation • 32B • Updated Mar 11 • 117

QuantTrio/sarvam-30b-AWQ

Text Generation • 7B • Updated Mar 13 • 562 • 1

mira-iitjmu/sarvam-30b-gptq-4bit

6B • Updated Mar 15 • 17

mtrajan/sarvam-30b-GGUF

Text Generation • 32B • Updated Mar 17 • 23 • 1

CompressEDai4good/sarvam-30b-compressed

Text Generation • 33B • Updated about 21 hours ago • 182

inferencerlabs/sarvamai-30b-MLX-10bit

Text Generation • 32B • Updated Mar 28 • 40 • 1

osmapi/sarvam-30b-TQ3_1S-GGUF

Text Generation • Updated Apr 2 • 7 • 2

AMbaye018/sarvam-30b-AWQ-then-FP8

Text Generation • 7B • Updated Apr 22 • 3

Orange/Sarvam-30b-GPTQ-w8a16

Text Generation • 10B • Updated Apr 29 • 351 • 2

Pranay2412/sarvam-30b-W8A8-FP8-Dynamic

Text Generation • 32B • Updated May 2

amir22010/sarvam-30b-gptq-4bit

Text Generation • 32B • Updated about 19 hours ago • 49

SaltyYean/sarvam-30b-FP8-BLOCK

32B • Updated May 4 • 3

Reinforce-ai/sarvam-30b-Spiral

Text Generation • Updated 28 days ago • 1.55k

saravanavel-e/sarvam-30b-fp8

Text Generation • 32B • Updated 5 days ago • 16

lalit-dumka/sarvam-30b-efficient

Text Generation • 7B • Updated about 22 hours ago • 12

Shankara-A-S/sarvam-30b-silentmarlin

Text Generation • 6B • Updated 2 days ago • 15

MehulChourasia/sarvam-30b-compressed

32B • Updated about 10 hours ago

Pranay2412/sarvam-30b-W4A16-Autoround

Text Generation • 7B • Updated about 20 hours ago

Shankara-A-S/sarvam-30b-godspeed

Text Generation • 6B • Updated about 9 hours ago