Instructions to use aisyahsyihab/voxcpm-lora-indonesian-female with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- VoxCPM
How to use aisyahsyihab/voxcpm-lora-indonesian-female with VoxCPM:
import soundfile as sf from voxcpm import VoxCPM model = VoxCPM.from_pretrained("aisyahsyihab/voxcpm-lora-indonesian-female") wav = model.generate( text="VoxCPM is an innovative end-to-end TTS model from ModelBest, designed to generate highly expressive speech.", prompt_wav_path=None, # optional: path to a prompt speech for voice cloning prompt_text=None, # optional: reference text cfg_value=2.0, # LM guidance on LocDiT, higher for better adherence to the prompt, but maybe worse inference_timesteps=10, # LocDiT inference timesteps, higher for better result, lower for fast speed normalize=True, # enable external TN tool denoise=True, # enable external Denoise tool retry_badcase=True, # enable retrying mode for some bad cases (unstoppable) retry_badcase_max_times=3, # maximum retrying times retry_badcase_ratio_threshold=6.0, # maximum length restriction for bad case detection (simple but effective), it could be adjusted for slow pace speech ) sf.write("output.wav", wav, 16000) print("saved: output.wav") - Notebooks
- Google Colab
- Kaggle
VoxCPM LoRA - Indonesian Female Voice
LoRA adapter for VoxCPM 1.5 fine-tuned for natural Indonesian female speech.
Model Details
| Property | Value |
|---|---|
| Base model | openbmb/VoxCPM1.5 (800M params) |
| LoRA rank (r) | 32 |
| LoRA alpha | 16 |
| Training steps | 3500 |
| Training samples | 112 clips |
| Final loss | 0.790 |
| Sample rate | 44.1 kHz |
Installation
Safetensors support requires the latest VoxCPM from GitHub:
pip install git+https://github.com/openbmb/VoxCPM.git
Usage
from voxcpm import VoxCPM
from huggingface_hub import snapshot_download
import soundfile as sf
# Download LoRA
lora_path = snapshot_download("aisyahsyihab/voxcpm-lora-indonesian-female")
# Load model with LoRA
model = VoxCPM.from_pretrained(
"openbmb/VoxCPM1.5",
lora_weights_path=lora_path,
load_denoiser=False
)
# Generate speech
audio = model.generate(
text="Halo, apa kabar hari ini?",
cfg_value=3.0,
normalize=True
)
# Save output
sf.write("output.wav", audio, model.tts_model.sample_rate)
Training Configuration
lora:
enable_lm: true
enable_dit: true
enable_proj: false
r: 32
alpha: 16
dropout: 0.0
target_modules_lm: ["q_proj", "v_proj", "k_proj", "o_proj"]
target_modules_dit: ["q_proj", "v_proj", "k_proj", "o_proj"]
training:
batch_size: 2
grad_accum_steps: 4
learning_rate: 0.0001
warmup_steps: 100
max_steps: 4000
Hardware Requirements
- Training: NVIDIA RTX 3090 (24GB VRAM)
- Inference: ~4GB VRAM (with base model)
Inference Tips
- CFG value: 2.0-4.0 (higher = more adherence to voice, lower = more natural)
- Best for: Casual Indonesian speech, conversational tone
- Optimal text length: 1-3 sentences at a time
License
Apache 2.0 (following VoxCPM base model license)
Acknowledgments
- OpenBMB for VoxCPM 1.5
- Training conducted with VoxCPM's official LoRA training pipeline