---
license: mit
language:
  - en
library_name: mlx
tags:
  - speech
  - feature-extraction
  - wavlm
  - mlx
  - safetensors
  - speaker-embedding
  - voice-cloning
  - indic-mio
base_model: microsoft/wavlm-base-plus
pipeline_tag: feature-extraction
---

# WavLM Base Plus MLX fp16

MLX-compatible safetensors export of
[microsoft/wavlm-base-plus](https://huggingface.co/microsoft/wavlm-base-plus).
This bundle is used by speech-swift as the SSL feature-extractor companion for
Indic-Mio raw-reference voice cloning.

WavLM runs on 16 kHz mono speech audio and produces hidden states that downstream
speech models can use for speaker, content, and paralinguistic representations.
For Indic-Mio, speech-swift averages hidden layers 1 and 2, then feeds those
features into MioCodec's global encoder to produce the 128-dimensional speaker
embedding used by the decoder.

Part of [soniqo.audio](https://soniqo.audio), an on-device speech toolkit.

## Model

| Field | Value |
|---|---|
| Base model | `microsoft/wavlm-base-plus` |
| Architecture | WavLM / HuBERT-style SSL encoder |
| Parameters | 94M class |
| Format | MLX-compatible safetensors |
| Quantization | None |
| Precision | fp16-compatible safetensors export |
| Sample rate | 16 kHz |
| Hidden size | 768 |
| Layers | 12 Transformer layers |
| Attention heads | 12 |
| Runtime use | Indic-Mio raw-reference speaker embedding companion |

## Files

| File | Size | Description |
|---|---:|---|
| `model.safetensors` | 360 MB | WavLM weights in safetensors format |
| `config.json` | 2.2 KB | WavLM model configuration |
| `preprocessor_config.json` | 215 B | 16 kHz audio feature-extractor metadata |
| `soniqo_manifest.json` | 622 B | Runtime/export metadata |

## Performance

| Check | Result |
|---|---|
| Weight load | Passes in speech-swift WavLM companion loader |
| Indic-Mio raw-reference embedding | Produces finite 128-dimensional MioCodec global embedding |
| Indic-Mio raw-reference synthesis | Passes local E2E synthesis test |
| Hindi ASR sanity on generated clone sample | Recovered `नमस्ते यह संदर्भा आवाज़` |

## Usage

### Swift

```swift
import IndicMioTTS

let model = try await IndicMioTTSModel.fromPretrained()
let audio = try await model.generate(
    text: "नमस्ते, यह संदर्भ आवाज़ का परीक्षण है। <happy>",
    language: "hindi",
    referenceAudio: referenceSamples,
    referenceSampleRate: referenceSampleRate
)
```

The runtime downloads this companion automatically when raw reference audio is
used. For local testing with a pre-downloaded bundle:

```bash
export INDIC_MIO_WAVLM_BUNDLE=/path/to/WavLM-Base-Plus-MLX-fp16
```

### CLI

```bash
speech speak \
  --engine indic-mio \
  --voice-sample reference.wav \
  --output clone.wav \
  "नमस्ते, यह संदर्भ आवाज़ का परीक्षण है। <happy>"
```

## Source

Converted from [microsoft/wavlm-base-plus](https://huggingface.co/microsoft/wavlm-base-plus).
The upstream WavLM source project is available from
[microsoft/unilm](https://github.com/microsoft/unilm/tree/master/wavlm).

## Links

- [speech-swift](https://github.com/soniqo/speech-swift) — Apple SDK
- [Speech Studio](https://soniqo.audio/speech-studio) — local speech generation and voice cloning app
- [Docs](https://soniqo.audio/getting-started) — install and CLI docs
- [soniqo.audio](https://soniqo.audio) — website
- [blog](https://soniqo.audio/blog) — blog

## License

MIT, following the upstream WavLM source project license.