---
license: mit
library_name: caix
pipeline_tag: text-generation
base_model: zai-org/GLM-4-32B-0414
tags:
- caix
- apple-silicon
- core-ai
- text-generation
---

# GLM 4 32B 0414 INT8 - caix

<p align="center">
  <img src="https://huggingface.co/spaces/redhillsmediafl/README/resolve/main/rhm-full-logo.png" alt="Red Hills Media" width="120">
</p>

Run **GLM 4 32B 0414 INT8** locally with caix.

## Install & run

```bash
brew install redhillsmediafl/caix/caix
caix catalog install redhillsmediafl/rhm-glm-4-32b-0414-int8-caix
caix serve --model glm-4-32b-0414-int8-coreai-ctx32768
```

## At a glance

- **Base model:** [zai-org/GLM-4-32B-0414](https://huggingface.co/zai-org/GLM-4-32B-0414)
- **Context:** 32,768 tokens (matches base model)
- **Quantization:** int8 Core AI
- **Disk:** 30.4 GB
- **Runs on:** Apple silicon with caix 0.2.13-beta+

## Status

| Package | Runtime | Hardware | RAM | Model | Prompt | Output tokens | Median tok/s |
|---|---|---|---:|---|---|---:|---:|
| this package | standalone | Apple M1 Ultra | 64 GB | Mac Studio (2022) | default decode | 128 | pending verified result |

```bash
caix catalog performance-report --model ~/.caix/models/exports/glm-4-32b-0414-int8-coreai-ctx32768 --repo redhillsmediafl/rhm-glm-4-32b-0414-int8-caix
```

## License

[MIT](https://opensource.org/license/mit)

<sub>More open-source work: [redhillsmediafl.com/open-source](https://redhillsmediafl.com/open-source).</sub>