---
license: other
license_name: minimax-community
license_link: LICENSE
base_model:
- MiniMaxAI/MiniMax-M3
---


<div align="center">
  <img 
    src="https://cdn-uploads.huggingface.co/production/uploads/64b93e6bd6c468ac7536607e/mj6xac74jHGLqymiovObc.png" 
    alt="The Kaitchup -- AI on a Budget" 
    style="width: 100%; max-width: 100%; height: auto; display: inline-block; margin-bottom: 0.5em; margin-top: 0.5em;"
  />
  <div style="display: flex; justify-content: center; gap: 0.5em; margin-bottom: 1em;">
    <a href="https://kaitchup.substack.com/subscribe"><strong>Subscribe and Support</strong></a>
  </div>
</div>


GGUF models made with the method ("Mixture of Quantizations") proposed by [Waleed Ahmad](https://huggingface.co/w-ahmad).
I also used Unsloth [M3's imatrix](https://huggingface.co/unsloth/MiniMax-M3-GGUF) for calibration.

More details and evaluation here:
[MiniMax M3 GGUF Quantization: From 852 GB to ~150 GB Without Breaking Accuracy](https://kaitchup.substack.com/p/minimax-m3-gguf-quantization-from)

![image](https://cdn-uploads.huggingface.co/production/uploads/64b93e6bd6c468ac7536607e/Wx2xnH4miXHQDZ8e4Avvw.png)

Avoid using the MoQ-2.5.


* Compute Sponsorship: [Verda](https://verda.com/?utm_source=kaitchup.substack.com&utm_medium=referral&utm_content=m3quant). I used 2 B300s for quantization and evaluation.