gasoonjia commited on
Commit
f986b12
·
verified ·
1 Parent(s): daa8b45

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -15
README.md CHANGED
@@ -52,9 +52,8 @@ This repository contains an ExecuTorch `.pte` export of the Hugging Face ASR mod
52
  Build the Voxtral runner from an ExecuTorch checkout:
53
 
54
  ```bash
55
- ./install_executorch.sh
56
- # Build Metal runner for macOS
57
- cmake -DEXECUTORCH_BUILD_METAL=ON ...
58
  ```
59
 
60
  Then run inference:
@@ -62,24 +61,13 @@ Then run inference:
62
  ### Metal (macOS)
63
 
64
  ```bash
65
- DYLD_LIBRARY_PATH=/usr/lib ./cmake-out/examples/models/voxtral/voxtral_runner \
66
  --model_path /path/to/model.pte \
67
  --preprocessor_path /path/to/voxtral_preprocessor.pte \
68
  --audio_path /path/to/audio.wav \
69
  --tokenizer_path /path/to/tekken.json
70
  ```
71
 
72
- ## Export Recipe (ExecuTorch)
73
-
74
- Exports were produced using ExecuTorch's Voxtral export script:
75
-
76
- ```bash
77
- python examples/models/voxtral/export_voxtral.py \
78
- --backend metal \
79
- --dtype bf16 \
80
- --output-dir ./voxtral_metal_bf16
81
- ```
82
-
83
  ## License / Attribution
84
 
85
  - Upstream model license: **Apache-2.0** (see [`mistralai/Voxtral-Mini-3B-2507`](https://huggingface.co/mistralai/Voxtral-Mini-3B-2507)).
 
52
  Build the Voxtral runner from an ExecuTorch checkout:
53
 
54
  ```bash
55
+ EXECUTORCH_BUILD_KERNELS_TORCHAO=1 TORCHAO_BUILD_EXPERIMENTAL_MPS=1 ./install_executorch.sh
56
+ make voxtral-metal
 
57
  ```
58
 
59
  Then run inference:
 
61
  ### Metal (macOS)
62
 
63
  ```bash
64
+ ./cmake-out/examples/models/voxtral/voxtral_runner \
65
  --model_path /path/to/model.pte \
66
  --preprocessor_path /path/to/voxtral_preprocessor.pte \
67
  --audio_path /path/to/audio.wav \
68
  --tokenizer_path /path/to/tekken.json
69
  ```
70
 
 
 
 
 
 
 
 
 
 
 
 
71
  ## License / Attribution
72
 
73
  - Upstream model license: **Apache-2.0** (see [`mistralai/Voxtral-Mini-3B-2507`](https://huggingface.co/mistralai/Voxtral-Mini-3B-2507)).