---
base_model: mlx-community/gemma-4-31B-it-assistant-bf16
library_name: mlx
license: gemma
pipeline_tag: text-generation
tags:
- mlx
- speculative-decoding
- mtp
- gemma
- drafter
---

# guardiangate1775/gemma-4-31B-it-assistant-4bit

This model was converted to MLX format from [`mlx-community/gemma-4-31B-it-assistant-bf16`](https://huggingface.co/mlx-community/gemma-4-31B-it-assistant-bf16)
using mlx-vlm version **0.5.0**.
Refer to the [original model card](https://huggingface.co/mlx-community/gemma-4-31B-it-assistant-bf16) for more details on the model.

## Use with mlx

```bash
pip install -U mlx-vlm
```

```bash
python -m mlx_vlm.generate --model guardiangate1775/gemma-4-31B-it-assistant-4bit --max-tokens 100 --temperature 0.0 --prompt "Describe this image." --image <path_to_image>
```