Text-to-Speech
Transformers
Safetensors
higgs_multimodal_qwen3
text-generation
speech-generation
voice-agent
expressive-speech
controllable-tts
multilingual-tts
Instructions to use bosonai/higgs-tts-3-4b with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use bosonai/higgs-tts-3-4b with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-to-speech", model="bosonai/higgs-tts-3-4b")# Load model directly from transformers import AutoModelForSeq2SeqLM model = AutoModelForSeq2SeqLM.from_pretrained("bosonai/higgs-tts-3-4b", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Add vLLM-Omni as a self-hosting option for Higgs Audio v3
#16
by linyueqian - opened
README.md
CHANGED
|
@@ -510,6 +510,27 @@ Throughput on Seed-TTS EN (full set, **N=1088** per run). Client `--max-concurre
|
|
| 510 |
|
| 511 |
To reproduce the results, follow the instructions in [this script](https://github.com/sgl-project/sglang-omni/blob/main/benchmarks/eval/benchmark_tts_seedtts.py).
|
| 512 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 513 |
### API Usage
|
| 514 |
|
| 515 |
For zero-ops deployment, use the [**Boson AI API**](https://docs.boson.ai/models/higgs-audio-tts/overview).
|
|
|
|
| 510 |
|
| 511 |
To reproduce the results, follow the instructions in [this script](https://github.com/sgl-project/sglang-omni/blob/main/benchmarks/eval/benchmark_tts_seedtts.py).
|
| 512 |
|
| 513 |
+
### vLLM-Omni Usage
|
| 514 |
+
|
| 515 |
+
You can also serve these weights with [**vLLM-Omni**](https://github.com/vllm-project/vllm-omni), which exposes the same OpenAI-compatible `/v1/audio/speech` API with zero-shot voice cloning.
|
| 516 |
+
|
| 517 |
+
```bash
|
| 518 |
+
hf download bosonai/higgs-audio-v3-tts-4b
|
| 519 |
+
|
| 520 |
+
vllm-omni serve bosonai/higgs-audio-v3-tts-4b \
|
| 521 |
+
--host 0.0.0.0 --port 8095 \
|
| 522 |
+
--trust-remote-code --omni
|
| 523 |
+
```
|
| 524 |
+
|
| 525 |
+
```bash
|
| 526 |
+
curl -X POST http://localhost:8095/v1/audio/speech \
|
| 527 |
+
-H "Content-Type: application/json" \
|
| 528 |
+
-d '{"model": "bosonai/higgs-audio-v3-tts-4b", "input": "Hello, how are you?"}' \
|
| 529 |
+
--output output.wav
|
| 530 |
+
```
|
| 531 |
+
|
| 532 |
+
Plain-text TTS, voice-clone, and benchmark recipes are in the [vLLM-Omni Higgs Audio v3 recipe](https://github.com/vllm-project/vllm-omni/blob/main/recipes/BosonAI/Higgs-Audio-V3-TTS.md).
|
| 533 |
+
|
| 534 |
### API Usage
|
| 535 |
|
| 536 |
For zero-ops deployment, use the [**Boson AI API**](https://docs.boson.ai/models/higgs-audio-tts/overview).
|