Text-to-Speech
MLX
Safetensors
Zonos
English
apple-silicon
tts
voice-cloning
zonos2
Mixture of Experts
Instructions to use shraey/zonos2-mlx with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use shraey/zonos2-mlx with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] huggingface-cli download --local-dir zonos2-mlx shraey/zonos2-mlx
- Zonos
How to use shraey/zonos2-mlx with Zonos:
# pip install git+https://github.com/Zyphra/Zonos.git import torchaudio from zonos.model import Zonos from zonos.conditioning import make_cond_dict model = Zonos.from_pretrained("shraey/zonos2-mlx", device="cuda") wav, sr = torchaudio.load("speaker.wav") # 5-10s reference clip speaker = model.make_speaker_embedding(wav, sr) cond = make_cond_dict(text="Hello, world!", speaker=speaker, language="en-us") codes = model.generate(model.prepare_conditioning(cond)) audio = model.autoencoder.decode(codes)[0].cpu() torchaudio.save("sample.wav", audio, model.autoencoder.sampling_rate) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
Model card: use upstream's 'voice cloning' wording
Browse files
README.md
CHANGED
|
@@ -24,7 +24,7 @@ autoregressive text-to-speech model β running natively on Apple Silicon.
|
|
| 24 |
|
| 25 |
**Download and run. No PyTorch in the inference path, no conversion step.**
|
| 26 |
|
| 27 |
-
- π§ **Model:** 16-expert top-1 MoE AR trunk (layer 26 routes top-2) β DAC 44.1 kHz neural codec for the waveform, with an ECAPA-TDNN speaker encoder (+ LDA) for
|
| 28 |
- π **Runtime:** [`sb1992/mlx-zonos2`](https://github.com/sb1992/mlx-zonos2) β a clean-room MLX reimplementation of the inference runtime, gated per-stage against the original PyTorch model.
|
| 29 |
- π¦ **This repo:** the weights only. Three precision tiers, each a **self-contained folder**.
|
| 30 |
|
|
@@ -77,7 +77,7 @@ Python API, the enroll-once flow, and the full parity report.
|
|
| 77 |
|
| 78 |
## Responsible use
|
| 79 |
|
| 80 |
-
This performs **
|
| 81 |
of audio. Use it responsibly: no impersonation, fraud, or disinformation; only clone voices you
|
| 82 |
own or have explicit consent for; disclose AI-generated audio wherever it's published. See the
|
| 83 |
[runtime repo](https://github.com/sb1992/mlx-zonos2) for the full policy.
|
|
|
|
| 24 |
|
| 25 |
**Download and run. No PyTorch in the inference path, no conversion step.**
|
| 26 |
|
| 27 |
+
- π§ **Model:** 16-expert top-1 MoE AR trunk (layer 26 routes top-2) β DAC 44.1 kHz neural codec for the waveform, with an ECAPA-TDNN speaker encoder (+ LDA) for voice cloning from a short reference clip.
|
| 28 |
- π **Runtime:** [`sb1992/mlx-zonos2`](https://github.com/sb1992/mlx-zonos2) β a clean-room MLX reimplementation of the inference runtime, gated per-stage against the original PyTorch model.
|
| 29 |
- π¦ **This repo:** the weights only. Three precision tiers, each a **self-contained folder**.
|
| 30 |
|
|
|
|
| 77 |
|
| 78 |
## Responsible use
|
| 79 |
|
| 80 |
+
This performs **voice cloning** β it can reproduce a person's voice from a few seconds
|
| 81 |
of audio. Use it responsibly: no impersonation, fraud, or disinformation; only clone voices you
|
| 82 |
own or have explicit consent for; disclose AI-generated audio wherever it's published. See the
|
| 83 |
[runtime repo](https://github.com/sb1992/mlx-zonos2) for the full policy.
|