Luigi commited on
Commit
79a7ce3
·
verified ·
1 Parent(s): bbc906f

model card: prompt-slot guidance — the FT repairs `auto` (base 50.58 -> 11.33 CER, best slot); all slots within ~0.7 CER

Browse files
Files changed (1) hide show
  1. README.md +18 -4
README.md CHANGED
@@ -20,12 +20,25 @@ Supersedes v1 (which packaged the zero-training warm-start).
20
 
21
  ## Accuracy
22
 
23
- | build | CV zh-TW CER |
24
  |---|---|
25
- | fp32 fine-tuned model (reference) | 12.03 |
26
- | **this q4-mix LiteRT** | **13.90** (+1.87 INT4 cost) |
27
  | v1 q4-mix (base warm-start) | ~38 |
28
 
 
 
 
 
 
 
 
 
 
 
 
 
 
29
  Other languages (fp32 FT, vs base): ko/de/ja/hi/en all improve, ar flat,
30
  fr/es +1.5 — see the [source model card](https://huggingface.co/Luigi/nemotron-3.5-asr-streaming-0.6b-zhtw).
31
 
@@ -45,7 +58,8 @@ Port, runner and integration note:
45
  https://github.com/vieenrose/LiteRT/tree/nemotron/litert/samples/asr/nemotron
46
 
47
  ```bash
48
- python -m nemotron.runner --models ./ --wav clip.wav --lang zh-TW --s2t --itn
 
49
  ```
50
 
51
  **Output is Simplified Chinese** — the tokenizer cannot represent many common
 
20
 
21
  ## Accuracy
22
 
23
+ | build | CV zh-TW CER (n=120) |
24
  |---|---|
25
+ | fp32 fine-tuned model (reference) | 11.33 |
26
+ | **this q4-mix LiteRT** | **13.20** (+1.9 INT4 cost) |
27
  | v1 q4-mix (base warm-start) | ~38 |
28
 
29
+ Per language-prompt slot on this build — all within ~0.7 CER, pick either:
30
+
31
+ | slot | q4-mix CER | fp32 CER |
32
+ |---|---|---|
33
+ | `zh-CN` (4) | **13.20** | 11.57 |
34
+ | `auto` (101) | 13.79 | **11.33** |
35
+ | `zh-TW` (5) | 13.90 | 12.03 |
36
+
37
+ `auto` was the *worst* slot on the base model (50.58 CER) and is repaired by the
38
+ fine-tune — training used `prompt_mode: unified`, which trains the auto path
39
+ alongside the explicit language ID. Use `auto` when the speaker may switch
40
+ languages, or an explicit slot when you know it.
41
+
42
  Other languages (fp32 FT, vs base): ko/de/ja/hi/en all improve, ar flat,
43
  fr/es +1.5 — see the [source model card](https://huggingface.co/Luigi/nemotron-3.5-asr-streaming-0.6b-zhtw).
44
 
 
58
  https://github.com/vieenrose/LiteRT/tree/nemotron/litert/samples/asr/nemotron
59
 
60
  ```bash
61
+ python -m nemotron.runner --models ./ --wav clip.wav --lang zh-CN --s2t --itn
62
+ # --lang auto also works well (see slot table); --s2t gives Traditional output
63
  ```
64
 
65
  **Output is Simplified Chinese** — the tokenizer cannot represent many common