majentik/Nemotron-3-Nano-30B-A3B-RotorQuant-GGUF-IQ4_XS
Text Generation • 32B • Updated • 197
Nemotron — quantized
Quantized GGUF and MLX packs of the Nemotron 3 model family (Nano, Nano-Omni, Super).
-
-
majentik/Nemotron-3-Nano-30B-A3B-RotorQuant-GGUF-Q2_K
Text Generation • 32B • Updated • 70 -
majentik/Nemotron-3-Nano-30B-A3B-RotorQuant-GGUF-Q3_K_M
Text Generation • 32B • Updated • 76 -
majentik/Nemotron-3-Nano-30B-A3B-RotorQuant-GGUF-Q4_K_M
Text Generation • 32B • Updated • 106 -
majentik/Nemotron-3-Nano-30B-A3B-RotorQuant-GGUF-Q5_K_M
Text Generation • 32B • Updated • 81 -
majentik/Nemotron-3-Nano-30B-A3B-RotorQuant-GGUF-Q8_0
Text Generation • 32B • Updated • 89 -
majentik/Nemotron-3-Nano-30B-A3B-RotorQuant-MLX-2bit
Text Generation • 32B • Updated • 164 -
majentik/Nemotron-3-Nano-30B-A3B-RotorQuant-MLX-4bit
Text Generation • 32B • Updated • 77 -
majentik/Nemotron-3-Nano-30B-A3B-RotorQuant-MLX-8bit
Text Generation • 32B • Updated • 77 -
majentik/Nemotron-3-Nano-30B-A3B-TurboQuant-GGUF-Q4_K_M
Text Generation • 32B • Updated • 186 • 1 -
majentik/Nemotron-3-Nano-30B-A3B-TurboQuant-GGUF-Q8_0
Text Generation • 32B • Updated • 75 -
majentik/Nemotron-3-Nano-30B-A3B-TurboQuant-MLX-2bit
Text Generation • 32B • Updated • 154 -
majentik/Nemotron-3-Nano-30B-A3B-TurboQuant-MLX-4bit
Text Generation • 32B • Updated • 75 • 1 -
majentik/Nemotron-3-Nano-30B-A3B-TurboQuant-MLX-8bit
Text Generation • 32B • Updated • 56 -
majentik/Nemotron-3-Nano-4B-RotorQuant-GGUF-IQ4_XS
Text Generation • 4B • Updated • 229 • 1 -
majentik/Nemotron-3-Nano-4B-RotorQuant-GGUF-Q2_K
Text Generation • 4B • Updated • 76 -
majentik/Nemotron-3-Nano-4B-RotorQuant-GGUF-Q3_K_M
Text Generation • 4B • Updated • 85 -
majentik/Nemotron-3-Nano-4B-RotorQuant-GGUF-Q4_K_M
Text Generation • 4B • Updated • 100 -
majentik/Nemotron-3-Nano-4B-RotorQuant-MLX-2bit
Text Generation • 0.4B • Updated • 171 -
majentik/Nemotron-3-Nano-4B-RotorQuant-MLX-4bit
Text Generation • 0.6B • Updated • 93 -
majentik/Nemotron-3-Nano-4B-RotorQuant-MLX-8bit
Text Generation • 1B • Updated • 115 -
majentik/Nemotron-3-Nano-4B-TurboQuant-GGUF-Q4_K_M
Text Generation • 4B • Updated • 224 -
majentik/Nemotron-3-Nano-4B-TurboQuant-MLX-2bit
Text Generation • 0.4B • Updated • 169 -
majentik/Nemotron-3-Nano-4B-TurboQuant-MLX-4bit
Text Generation • 0.6B • Updated • 126 -
majentik/Nemotron-3-Nano-4B-TurboQuant-MLX-8bit
Text Generation • 1B • Updated • 141 -
majentik/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-RotorQuant-GGUF-IQ4_XS
Image-Text-to-Text • 32B • Updated • 454 -
majentik/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-RotorQuant-GGUF-MXFP4_MOE
Image-Text-to-Text • 32B • Updated • 498 -
majentik/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-RotorQuant-GGUF-Q2_K
Image-Text-to-Text • 32B • Updated • 541 • 1 -
majentik/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-RotorQuant-GGUF-Q3_K_M
Image-Text-to-Text • 32B • Updated • 472 -
majentik/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-RotorQuant-GGUF-Q4_K_M
Image-Text-to-Text • 32B • Updated • 473 -
majentik/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-RotorQuant-GGUF-Q5_K_M
Image-Text-to-Text • 32B • Updated • 472 -
majentik/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-RotorQuant-GGUF-Q8_0
Image-Text-to-Text • 32B • Updated • 479 -
majentik/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-RotorQuant-MLX-2bit
Text Generation • 4B • Updated • 209 • 1 -
majentik/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-RotorQuant-MLX-3bit
Text Generation • 5B • Updated • 173 -
majentik/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-RotorQuant-MLX-4bit
Text Generation • 6B • Updated • 83 -
majentik/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-RotorQuant-MLX-5bit
Text Generation • 7B • Updated • 167 -
majentik/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-RotorQuant-MLX-6bit
Text Generation • 8B • Updated • 160 -
majentik/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-RotorQuant-MLX-8bit
Text Generation • 10B • Updated • 108 -
majentik/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-RotorQuant-MLX-MXFP4
Text Generation • 7B • Updated • 291 -
majentik/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-TurboQuant-GGUF-IQ4_XS
Image-Text-to-Text • 32B • Updated • 720 • 1 -
majentik/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-TurboQuant-GGUF-MXFP4_MOE
Image-Text-to-Text • 32B • Updated • 690 -
majentik/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-TurboQuant-GGUF-Q2_K
Image-Text-to-Text • 32B • Updated • 510 -
majentik/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-TurboQuant-GGUF-Q3_K_M
Image-Text-to-Text • 32B • Updated • 525 -
majentik/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-TurboQuant-GGUF-Q4_K_M
Image-Text-to-Text • 32B • Updated • 597 -
majentik/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-TurboQuant-GGUF-Q5_K_M
Image-Text-to-Text • 32B • Updated • 553 -
majentik/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-TurboQuant-GGUF-Q8_0
Image-Text-to-Text • 32B • Updated • 599 • 1 -
majentik/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-TurboQuant-MLX-2bit
Text Generation • 4B • Updated • 201 -
majentik/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-TurboQuant-MLX-3bit
Text Generation • 5B • Updated • 198 -
majentik/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-TurboQuant-MLX-4bit
Text Generation • 6B • Updated • 89 -
majentik/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-TurboQuant-MLX-5bit
Text Generation • 7B • Updated • 220 -
majentik/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-TurboQuant-MLX-6bit
Text Generation • 8B • Updated • 234 -
majentik/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-TurboQuant-MLX-8bit
Text Generation • 10B • Updated • 236 -
majentik/Nemotron-3-Super-120B-A12B-RotorQuant-GGUF-Q2_K
Text Generation • 121B • Updated • 90 -
majentik/Nemotron-3-Super-120B-A12B-RotorQuant-GGUF-Q3_K_M
Text Generation • 121B • Updated • 82 -
majentik/Nemotron-3-Super-120B-A12B-RotorQuant-GGUF-Q4_K_M
Text Generation • 121B • Updated • 357 -
majentik/Nemotron-3-Super-120B-A12B-RotorQuant-GGUF-Q5_K_M
Text Generation • 121B • Updated • 82 -
majentik/Nemotron-3-Super-120B-A12B-RotorQuant-GGUF-Q6_K
Text Generation • 121B • Updated • 90 -
majentik/Nemotron-3-Super-120B-A12B-RotorQuant-GGUF-Q8_0
Text Generation • 121B • Updated • 113 -
majentik/Nemotron-3-Super-120B-A12B-TurboQuant-GGUF-Q2_K
Text Generation • 121B • Updated • 97 -
majentik/Nemotron-3-Super-120B-A12B-TurboQuant-GGUF-Q3_K_M
Text Generation • 121B • Updated • 93