Automatic Speech Recognition
LiteRT
LiteRT
nemotron3_5_asr
streaming-asr
FastConformer
RNNT
zh-tw
q4
Instructions to use Luigi/nemotron-asr-litert-zhtw with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- LiteRT
How to use Luigi/nemotron-asr-litert-zhtw with LiteRT:
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js
- Notebooks
- Google Colab
- Kaggle
model card: prompt-slot guidance — the FT repairs `auto` (base 50.58 -> 11.33 CER, best slot); all slots within ~0.7 CER
Browse files
README.md
CHANGED
|
@@ -20,12 +20,25 @@ Supersedes v1 (which packaged the zero-training warm-start).
|
|
| 20 |
|
| 21 |
## Accuracy
|
| 22 |
|
| 23 |
-
| build | CV zh-TW CER |
|
| 24 |
|---|---|
|
| 25 |
-
| fp32 fine-tuned model (reference) |
|
| 26 |
-
| **this q4-mix LiteRT** | **13.
|
| 27 |
| v1 q4-mix (base warm-start) | ~38 |
|
| 28 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 29 |
Other languages (fp32 FT, vs base): ko/de/ja/hi/en all improve, ar flat,
|
| 30 |
fr/es +1.5 — see the [source model card](https://huggingface.co/Luigi/nemotron-3.5-asr-streaming-0.6b-zhtw).
|
| 31 |
|
|
@@ -45,7 +58,8 @@ Port, runner and integration note:
|
|
| 45 |
https://github.com/vieenrose/LiteRT/tree/nemotron/litert/samples/asr/nemotron
|
| 46 |
|
| 47 |
```bash
|
| 48 |
-
python -m nemotron.runner --models ./ --wav clip.wav --lang zh-
|
|
|
|
| 49 |
```
|
| 50 |
|
| 51 |
**Output is Simplified Chinese** — the tokenizer cannot represent many common
|
|
|
|
| 20 |
|
| 21 |
## Accuracy
|
| 22 |
|
| 23 |
+
| build | CV zh-TW CER (n=120) |
|
| 24 |
|---|---|
|
| 25 |
+
| fp32 fine-tuned model (reference) | 11.33 |
|
| 26 |
+
| **this q4-mix LiteRT** | **13.20** (+1.9 INT4 cost) |
|
| 27 |
| v1 q4-mix (base warm-start) | ~38 |
|
| 28 |
|
| 29 |
+
Per language-prompt slot on this build — all within ~0.7 CER, pick either:
|
| 30 |
+
|
| 31 |
+
| slot | q4-mix CER | fp32 CER |
|
| 32 |
+
|---|---|---|
|
| 33 |
+
| `zh-CN` (4) | **13.20** | 11.57 |
|
| 34 |
+
| `auto` (101) | 13.79 | **11.33** |
|
| 35 |
+
| `zh-TW` (5) | 13.90 | 12.03 |
|
| 36 |
+
|
| 37 |
+
`auto` was the *worst* slot on the base model (50.58 CER) and is repaired by the
|
| 38 |
+
fine-tune — training used `prompt_mode: unified`, which trains the auto path
|
| 39 |
+
alongside the explicit language ID. Use `auto` when the speaker may switch
|
| 40 |
+
languages, or an explicit slot when you know it.
|
| 41 |
+
|
| 42 |
Other languages (fp32 FT, vs base): ko/de/ja/hi/en all improve, ar flat,
|
| 43 |
fr/es +1.5 — see the [source model card](https://huggingface.co/Luigi/nemotron-3.5-asr-streaming-0.6b-zhtw).
|
| 44 |
|
|
|
|
| 58 |
https://github.com/vieenrose/LiteRT/tree/nemotron/litert/samples/asr/nemotron
|
| 59 |
|
| 60 |
```bash
|
| 61 |
+
python -m nemotron.runner --models ./ --wav clip.wav --lang zh-CN --s2t --itn
|
| 62 |
+
# --lang auto also works well (see slot table); --s2t gives Traditional output
|
| 63 |
```
|
| 64 |
|
| 65 |
**Output is Simplified Chinese** — the tokenizer cannot represent many common
|