DennisHuang648/VoxCPM-0.5B-GGUF

VoxCPM-0.5B — GGUF weights for llama.cpp-omni

GGUF-converted weights of openbmb/VoxCPM-0.5B for the C++/ggml engine llama.cpp-omni (tools/omni/voxcpm2). The lightest VoxCPM — runs TTS + voice cloning natively on CPU / Metal / CUDA / Vulkan, no PyTorch runtime required.

Files

File	Format	Size	Component
VoxCPM-0.5B-BaseLM-F16.gguf	F16	~974 MB	Base language model
VoxCPM-0.5B-BaseLM-Q8_0.gguf	Q8_0	~519 MB	Base language model, 8-bit (recommended)
VoxCPM-0.5B-Acoustic-F16.gguf	F16	~560 MB	Acoustic stack (ResidualLM + FSQ + CFM + AudioVAE)

Output: 16 kHz mono. Use one BaseLM (Q8_0 recommended) + the Acoustic file.

Usage

./voxcpm2-cli -t "Hello from VoxCPM 0.5B." -o out.wav \
    VoxCPM-0.5B-BaseLM-Q8_0.gguf VoxCPM-0.5B-Acoustic-F16.gguf
# voice cloning: add  -r speaker.wav

Verified on Apple M4 Pro / Metal (RTF ~1.06 — fastest of the VoxCPM family). Flags: --cfg, --timesteps, --seed, --temperature, -r (clone), --prompt-wav/--prompt-text (reference-transcript clone), --cpu. License/terms inherit from the upstream model.