Instructions to use True2456/gemma-4-12b-it-qat-4bit-frontierdistill with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use True2456/gemma-4-12b-it-qat-4bit-frontierdistill with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] huggingface-cli download --local-dir gemma-4-12b-it-qat-4bit-frontierdistill True2456/gemma-4-12b-it-qat-4bit-frontierdistill
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
|
@@ -3,13 +3,12 @@ base_model: mlx-community/gemma-4-12B-it-qat-4bit
|
|
| 3 |
license: gemma
|
| 4 |
library_name: mlx-vlm
|
| 5 |
tags:
|
| 6 |
-
- lora
|
| 7 |
-
- qlora
|
| 8 |
- gemma4
|
| 9 |
- agentic
|
| 10 |
- coding
|
| 11 |
- tool-use
|
| 12 |
- mlx
|
|
|
|
| 13 |
datasets:
|
| 14 |
- greghavens/fable-5-coding-and-debugging-traces
|
| 15 |
- greghavens/gpt-5.6-sol-coding-and-debugging-traces
|
|
@@ -18,7 +17,7 @@ datasets:
|
|
| 18 |
|
| 19 |
# gemma-4-12b-it-qat-4bit-frontierdistill
|
| 20 |
|
| 21 |
-
|
| 22 |
|
| 23 |
## Training data
|
| 24 |
|
|
@@ -60,7 +59,6 @@ The adapter meaningfully improves tool selection and argument correctness — th
|
|
| 60 |
```bash
|
| 61 |
pip install mlx-vlm
|
| 62 |
python -m mlx_vlm.generate \
|
| 63 |
-
--model
|
| 64 |
-
--adapter-path gemma-4-12b-it-qat-4bit-frontierdistill \
|
| 65 |
--prompt "Your prompt here"
|
| 66 |
```
|
|
|
|
| 3 |
license: gemma
|
| 4 |
library_name: mlx-vlm
|
| 5 |
tags:
|
|
|
|
|
|
|
| 6 |
- gemma4
|
| 7 |
- agentic
|
| 8 |
- coding
|
| 9 |
- tool-use
|
| 10 |
- mlx
|
| 11 |
+
- lora-merged
|
| 12 |
datasets:
|
| 13 |
- greghavens/fable-5-coding-and-debugging-traces
|
| 14 |
- greghavens/gpt-5.6-sol-coding-and-debugging-traces
|
|
|
|
| 17 |
|
| 18 |
# gemma-4-12b-it-qat-4bit-frontierdistill
|
| 19 |
|
| 20 |
+
[mlx-community/gemma-4-12B-it-qat-4bit](https://huggingface.co/mlx-community/gemma-4-12B-it-qat-4bit) with a rank-8 LoRA adapter fused in, fine-tuned for agentic coding and tool use. Standalone checkpoint — no separate adapter needed. Trained and merged on Apple Silicon (MLX) via [mlx-vlm](https://github.com/Blaizzy/mlx-vlm).
|
| 21 |
|
| 22 |
## Training data
|
| 23 |
|
|
|
|
| 59 |
```bash
|
| 60 |
pip install mlx-vlm
|
| 61 |
python -m mlx_vlm.generate \
|
| 62 |
+
--model True2456/gemma-4-12b-it-qat-4bit-frontierdistill \
|
|
|
|
| 63 |
--prompt "Your prompt here"
|
| 64 |
```
|