---
license: mit
language:
- en
- zh
pipeline_tag: text-generation
library_name: exllamav3
base_model: zai-org/GLM-4.5-Air
base_model_relation: quantized
tags:
  - exl3
---

exllamav3 quantizations of [zai-org/GLM-4.5-Air](https://huggingface.co/zai-org/GLM-4.5-Air). Please note that support for this model is currently in the dev branch of exllamav3.

Some bigger quants to complement [Turboderp's quants of this model](https://huggingface.co/turboderp/GLM-4.5-Air-exl3) and [DoctorShotgun's 5.0bpw h6](https://huggingface.co/Doctor-Shotgun/GLM-4.5-Air-exl3_5.0bpw-h6). GLM-4.5 (non-air) coming soon.

[6.00 bpw h6](https://huggingface.co/MikeRoz/GLM-4.5-Air-exl3/tree/6.00bpw_H6) 75.615 GiB    
[8.00 bpw h8](https://huggingface.co/MikeRoz/GLM-4.5-Air-exl3/tree/8.00bpw_H8) 100.344 GiB