A Self-Refining Framework for Enhancing ASR Using TTS-Synthesized Data
Paper • 2506.11130 • Published • 5
How to use Kenji8000/Breeze-ASR-25-mlx with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] huggingface-cli download --local-dir Breeze-ASR-25-mlx Kenji8000/Breeze-ASR-25-mlx
This model was converted to MLX format from MediaTek-Research/Breeze-ASR-25.
Breeze ASR 25 is an advanced ASR model fine-tuned from Whisper-large-v2, optimized for Taiwanese Mandarin and Mandarin-English code-switching scenarios.
pip install mlx-whisper
import mlx_whisper
result = mlx_whisper.transcribe(
"audio.wav",
path_or_hf_repo="Kenji8000/Breeze-ASR-25-mlx",
language="zh",
)
print(result["text"])
Tested on Mac Studio M2 Ultra 128GB, mlx-whisper 0.4.3, mlx 0.31.1:
| Metric | Value |
|---|---|
| RTF (Real-Time Factor) | 0.08x |
| Inference (model cached) | 0.52s for 6.3s audio |
| Memory (RSS) | ~3.1 GB |
Converted using mlx-examples/whisper/convert.py with dtype float16.
python convert.py --torch-name-or-path MediaTek-Research/Breeze-ASR-25 \
--mlx-path mlx_models/breeze-asr-25 --dtype float16
# Note: rename output model.safetensors → weights.safetensors for mlx-whisper
Quantized
Base model
openai/whisper-large-v2