---
license: apache-2.0
base_model: openai/gpt-oss-120b
library_name: mlx
tags:
- mlx
- omlx
- gpt_oss
- quantized
- oQ4
- apple-silicon
---

# gpt-oss-120b-oQ4

This is an oMLX oQ4 quantized MLX checkpoint for `gpt-oss-120b`, published for local inference with oMLX on Apple Silicon.

## Notes

- Quantized with oMLX oQ4.
- Non-expert tensors use the oQ4 affine quantization plan generated by oMLX.
- GPT-OSS MoE expert projection tensors are preserved as MXFP4 passthrough tensors and are marked with per-layer `mxfp4` overrides in `config.json`; this is required for oMLX/MLX loading.
- Tested locally with oMLX model discovery/load after generation.

## Local oMLX Use

Place or symlink the repo folder under an oMLX model directory, for example:

```bash
~/.omlx/models/cjnielson44/gpt-oss-120b-oQ4
```

Then load model id:

```text
gpt-oss-120b-oQ4
```

## Source

The local source checkpoint used for this conversion was the oMLX-compatible `gpt-oss-120b` MLX checkpoint in the Hugging Face cache.