Ddavidich/LOMONOSOV-ZENIT-27B-1M-INDEV
Text Generation • 16B • Updated • 527 • 1
Edit Models filters
Model Tree
Apps
Inference Providers
One-click Deployment
Models
209
Active filters: kv-cache-quantization
VAREQON/Nemotron-3-Nano-4B-RotorQuant-GGUF-Q2_K
Text Generation • 4B • Updated • 97 • 1
kuzyn8/Nemotron-3-Nano-4B-RotorQuant-GGUF-Q2_K
Text Generation • 4B • Updated • 108 • 2
rungalileo/llama-3.2-3B-instruct-trtllm-ckpt-wq_int4_awq-kv_int8
Text Generation • Updated • 11
rungalileo/mistral-7b-instruct-v0.3-trtllm-ckpt-wq_int4_awq-kv_int8
Text Generation • Updated • 6
rungalileo/llama-3.1-8b-instruct-trtllm-ckpt-wq_fp8-kv_fp8
Text Generation • Updated • 8
rungalileo/mistral-7b-instruct-v0.3-trtllm-ckpt-wq_fp8-kv_fp8
Text Generation • Updated • 10
rungalileo/llama-3.2-3b-instruct-trtllm-ckpt-wq_fp8-kv_fp8
Text Generation • Updated • 7
rungalileo/llama-3.2-3b-instruct-trtllm-ckpt-wq_nvfp4-kv_fp8
Text Generation • Updated • 7
rungalileo/llama-3.1-8b-instruct-trtllm-ckpt-wq_nvfp4-kv_fp8
Text Generation • Updated • 11
rungalileo/mistral-7b-instruct-v0.3-trtllm-ckpt-wq_nvfp4-kv_fp8
Text Generation • Updated • 5
rungalileo/llama-3.1-8b-instruct-trtllm-ckpt-wq_w8a8sq-kv_int8
Text Generation • Updated • 4
rungalileo/mistral-7b-instruct-v0.3-trtllm-ckpt-wq_w8a8sq-kv_int8
Text Generation • Updated • 5
majentik/gemma-4-E4B-turboquant
Image-Text-to-Text • 8B • Updated • 74 • 8
majentik/Qwen3.5-27B-TurboQuant-MLX-4bit
Text Generation • 27B • Updated • 249 • 2
majentik/Qwen3.5-27B-TurboQuant-MLX-8bit
Text Generation • 27B • Updated • 150
majentik/Qwen3.5-27B-RotorQuant-MLX-4bit
Text Generation • 27B • Updated • 215
majentik/Qwen3.5-27B-RotorQuant-MLX-8bit
Text Generation • 27B • Updated • 226
majentik/Mistral-Small-4-119B-TurboQuant-MLX-4bit
Text Generation • 19B • Updated • 402
majentik/Mistral-Small-4-119B-TurboQuant-MLX-2bit
Text Generation • 12B • Updated • 534 • 1
majentik/Mistral-Small-4-119B-RotorQuant-MLX-2bit
Text Generation • 12B • Updated • 332
majentik/Leanstral-TurboQuant-MLX-2bit
Text Generation • 23B • Updated • 401
majentik/Leanstral-RotorQuant-MLX-2bit
Text Generation • 23B • Updated • 382
majentik/Mistral-Small-4-119B-RotorQuant-MLX-4bit
Text Generation • 19B • Updated • 306
majentik/gemma-4-31B-TurboQuant-MLX-4bit
Image-Text-to-Text • 5B • Updated • 365 • 2
majentik/gemma-4-31B-TurboQuant-MLX-2bit
Image-Text-to-Text • 3B • Updated • 359 • 1
majentik/gemma-4-31B-TurboQuant-MLX-8bit
Image-Text-to-Text • 9B • Updated • 454 • 1
majentik/gemma-4-31B-RotorQuant-MLX-4bit
Image-Text-to-Text • 5B • Updated • 130
majentik/gemma-4-31B-RotorQuant-MLX-8bit
Image-Text-to-Text • 9B • Updated • 520 • 1
majentik/gemma-4-31B-RotorQuant-MLX-2bit
Image-Text-to-Text • 3B • Updated • 167