---
base_model:
- zai-org/GLM-4.7-Flash
tags:
- autoround
license: mit
---

<div align="center">
  <img 
    src="https://cdn-uploads.huggingface.co/production/uploads/64b93e6bd6c468ac7536607e/mj6xac74jHGLqymiovObc.png" 
    alt="The Kaitchup -- AI on a Budget" 
    style="width: 100%; max-width: 100%; height: auto; display: inline-block; margin-bottom: 0.5em; margin-top: 0.5em;"
  />
  <div style="display: flex; justify-content: center; gap: 0.5em; margin-bottom: 1em;">
    <a href="https://kaitchup.substack.com/subscribe"><strong>Subscribe and Support</strong></a>
  </div>
</div>


This is [zai-org/GLM-4.7-Flash](https://huggingface.co/zai-org/GLM-4.7-Flash) quantized with [AutoRound](https://github.com/intel/auto-round) to W4A16, with fallback to 16-bit for the first MLP layer and the shared experts. The model is compatible with vLLM (tested: v0.15.0). Tested with an RTX Pro 6000 WK.

- **Developed by:** [The Kaitchup](https://kaitchup.substack.com/)