Update README.md
Browse files
README.md
CHANGED
|
@@ -52,9 +52,8 @@ This repository contains an ExecuTorch `.pte` export of the Hugging Face ASR mod
|
|
| 52 |
Build the Voxtral runner from an ExecuTorch checkout:
|
| 53 |
|
| 54 |
```bash
|
| 55 |
-
./install_executorch.sh
|
| 56 |
-
|
| 57 |
-
cmake -DEXECUTORCH_BUILD_METAL=ON ...
|
| 58 |
```
|
| 59 |
|
| 60 |
Then run inference:
|
|
@@ -62,24 +61,13 @@ Then run inference:
|
|
| 62 |
### Metal (macOS)
|
| 63 |
|
| 64 |
```bash
|
| 65 |
-
|
| 66 |
--model_path /path/to/model.pte \
|
| 67 |
--preprocessor_path /path/to/voxtral_preprocessor.pte \
|
| 68 |
--audio_path /path/to/audio.wav \
|
| 69 |
--tokenizer_path /path/to/tekken.json
|
| 70 |
```
|
| 71 |
|
| 72 |
-
## Export Recipe (ExecuTorch)
|
| 73 |
-
|
| 74 |
-
Exports were produced using ExecuTorch's Voxtral export script:
|
| 75 |
-
|
| 76 |
-
```bash
|
| 77 |
-
python examples/models/voxtral/export_voxtral.py \
|
| 78 |
-
--backend metal \
|
| 79 |
-
--dtype bf16 \
|
| 80 |
-
--output-dir ./voxtral_metal_bf16
|
| 81 |
-
```
|
| 82 |
-
|
| 83 |
## License / Attribution
|
| 84 |
|
| 85 |
- Upstream model license: **Apache-2.0** (see [`mistralai/Voxtral-Mini-3B-2507`](https://huggingface.co/mistralai/Voxtral-Mini-3B-2507)).
|
|
|
|
| 52 |
Build the Voxtral runner from an ExecuTorch checkout:
|
| 53 |
|
| 54 |
```bash
|
| 55 |
+
EXECUTORCH_BUILD_KERNELS_TORCHAO=1 TORCHAO_BUILD_EXPERIMENTAL_MPS=1 ./install_executorch.sh
|
| 56 |
+
make voxtral-metal
|
|
|
|
| 57 |
```
|
| 58 |
|
| 59 |
Then run inference:
|
|
|
|
| 61 |
### Metal (macOS)
|
| 62 |
|
| 63 |
```bash
|
| 64 |
+
./cmake-out/examples/models/voxtral/voxtral_runner \
|
| 65 |
--model_path /path/to/model.pte \
|
| 66 |
--preprocessor_path /path/to/voxtral_preprocessor.pte \
|
| 67 |
--audio_path /path/to/audio.wav \
|
| 68 |
--tokenizer_path /path/to/tekken.json
|
| 69 |
```
|
| 70 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 71 |
## License / Attribution
|
| 72 |
|
| 73 |
- Upstream model license: **Apache-2.0** (see [`mistralai/Voxtral-Mini-3B-2507`](https://huggingface.co/mistralai/Voxtral-Mini-3B-2507)).
|