File size: 5,999 Bytes
faf1091 cbc1990 faf1091 cbc1990 246c62c faf1091 cbc1990 246c62c faf1091 cbc1990 246c62c cbc1990 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 | ---
language:
- lus
license: apache-2.0
base_model: Qwen/Qwen2-Audio-7B
tags:
- generated_from_trainer
datasets:
- andrewbawitlung/mizonal-v3
metrics:
- wer
- cer
model-index:
- name: qwen3-asr-0.6b-mizonal3-E1-lus-v2026.06
results:
- task:
name: Automatic Speech Recognition
type: automatic-speech-recognition
dataset:
name: MiZonal v3
type: andrewbawitlung/mizonal-v3
config: default
split: test
metrics:
- name: Wer
type: wer
value: 22.1262
- name: Cer
type: cer
value: 5.2278
- name: Real Time Factor
type: rtf
value: 0.0700
---
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->
# qwen3-asr-0.6b-mizonal3-E1-lus-v2026.06
This model is a fine-tuned version of [Qwen/Qwen2-Audio-7B](https://huggingface.co/Qwen/Qwen2-Audio-7B) on the **MiZonal v3** dataset.
Note: ~1 hour of conversational speech was added to this dataset version.
It achieves the following results on the evaluation set:
- Wer: 22.1262
- Cer: 5.2278
- Real Time Factor: 0.0700
## Model description
### Experiment Configurations
This repository is part of a series of experiments. The different configurations are:
- **E1 (Baseline):** Standard training configuration.
- **E2 (Noise):** Training with background noise augmentation.
- **E3 (Speed):** Training with speed perturbation augmentation.
- **E4 (SpecAug):** Training with SpecAugment (time and frequency masking).
- **E5 (Combined):** Training with a combination of all augmentations.
### All Models in this Family
| Experiment | Hugging Face Repository |
| :--- | :--- |
| **E1 (Baseline)** | [andrewbawitlung/qwen3-asr-0.6b-mizonal3-E1-lus-v2026.06](https://huggingface.co/andrewbawitlung/qwen3-asr-0.6b-mizonal3-E1-lus-v2026.06) |
| **E2 (Noise)** | [andrewbawitlung/qwen3-asr-0.6b-mizonal3-E2-lus-v2026.06](https://huggingface.co/andrewbawitlung/qwen3-asr-0.6b-mizonal3-E2-lus-v2026.06) |
| **E3 (Speed)** | [andrewbawitlung/qwen3-asr-0.6b-mizonal3-E3-lus-v2026.06](https://huggingface.co/andrewbawitlung/qwen3-asr-0.6b-mizonal3-E3-lus-v2026.06) |
| **E4 (SpecAug)** | [andrewbawitlung/qwen3-asr-0.6b-mizonal3-E4-lus-v2026.06](https://huggingface.co/andrewbawitlung/qwen3-asr-0.6b-mizonal3-E4-lus-v2026.06) |
| **E5 (Combined)** | [andrewbawitlung/qwen3-asr-0.6b-mizonal3-E5-lus-v2026.06](https://huggingface.co/andrewbawitlung/qwen3-asr-0.6b-mizonal3-E5-lus-v2026.06) |
## Intended uses & limitations
More information needed
## Training and evaluation data
More information needed
## Training procedure
### Training hyperparameters
The following hyperparameters were used during training:
- learning_rate: 2e-05
- train_batch_size: 16
- eval_batch_size: 8
- seed: 42
- optimizer: OptimizerNames.ADAMW_TORCH_FUSED
- lr_scheduler_type: SchedulerType.LINEAR
- num_epochs: 8
### Training results
| step | epoch | train_loss | eval_loss | eval_wer | eval_cer | learning_rate | grad_norm |
| --- | --- | --- | --- | --- | --- | --- | --- |
| 200 | 0.36429872495446264 | 0.3531 | 0.5678281188011169 | 0.42064804904154907 | 0.10793044953350296 | 1.9484200743494427e-05 | 11.4375 |
| 400 | 0.7285974499089253 | 0.2215 | 0.38337236642837524 | 0.3034932373260679 | 0.07453350296861748 | 1.855483271375465e-05 | 9.125 |
| 600 | 1.092896174863388 | 0.1323 | 0.33564406633377075 | 0.2659336382212708 | 0.06248232965790218 | 1.762546468401487e-05 | 8.75 |
| 800 | 1.4571948998178508 | 0.1034 | 0.3069060146808624 | 0.24978106451299018 | 0.06009683347469607 | 1.6696096654275093e-05 | 19.875 |
| 1000 | 1.8214936247723132 | 0.1023 | 0.2834382951259613 | 0.22983360902987254 | 0.053894543398360195 | 1.5766728624535318e-05 | 4.03125 |
| 1200 | 2.185792349726776 | 0.0753 | 0.2766484320163727 | 0.22370341539359737 | 0.051509047215154084 | 1.483736059479554e-05 | 5.625 |
| 1400 | 2.5500910746812386 | 0.0566 | 0.27566370368003845 | 0.21134572346015373 | 0.04871713316369805 | 1.3907992565055763e-05 | 4.71875 |
| 1600 | 2.9143897996357016 | 0.0573 | 0.2684209942817688 | 0.2139729493042717 | 0.0496006502685892 | 1.2978624535315987e-05 | 4.875 |
| 1800 | 3.278688524590164 | 0.037 | 0.28212207555770874 | 0.2136810353215919 | 0.050378145320893415 | 1.204925650557621e-05 | 3.75 |
| 2000 | 3.6429872495446265 | 0.0337 | 0.2878636121749878 | 0.20842658363335603 | 0.048699462821600224 | 1.111988847583643e-05 | 4.03125 |
| 2200 | 4.007285974499089 | 0.039 | 0.2856166362762451 | 0.23752067724043982 | 0.08289157478088775 | 1.0190520446096654e-05 | 5.4375 |
| 2400 | 4.371584699453552 | 0.0189 | 0.30527880787849426 | 0.21115111413836724 | 0.05044882668928471 | 9.261152416356878e-06 | 2.84375 |
| 2600 | 4.735883424408015 | 0.0178 | 0.3008843958377838 | 0.21280529337355258 | 0.05085524455753463 | 8.331784386617101e-06 | 2.6875 |
| 2800 | 5.100182149362477 | 0.0101 | 0.3245539367198944 | 0.21280529337355258 | 0.05157972858354538 | 7.402416356877325e-06 | 2.140625 |
| 3000 | 5.46448087431694 | 0.0122 | 0.3235035240650177 | 0.21407025396516494 | 0.05188012439920837 | 6.4730483271375465e-06 | 2.40625 |
| 3200 | 5.828779599271402 | 0.0102 | 0.32762861251831055 | 0.21173494210372676 | 0.05073155216284987 | 5.54368029739777e-06 | 2.1875 |
| 3400 | 6.193078324225866 | 0.0059 | 0.33911389112472534 | 0.21338912133891214 | 0.05253392705682782 | 4.614312267657993e-06 | 0.96875 |
| 3600 | 6.557377049180328 | 0.0074 | 0.341426283121109 | 0.2139729493042717 | 0.052198190556969185 | 3.684944237918216e-06 | 1.1484375 |
| 3800 | 6.9216757741347905 | 0.0084 | 0.3391820788383484 | 0.21037267685122119 | 0.05156205824144756 | 2.755576208178439e-06 | 2.125 |
| 4000 | 7.285974499089253 | 0.0079 | 0.34474754333496094 | 0.21309720735623236 | 0.051897794741306194 | 1.8262081784386618e-06 | 1.7421875 |
| 4200 | 7.6502732240437155 | 0.0082 | 0.34566405415534973 | 0.2145567772696312 | 0.052109838846480065 | 8.968401486988849e-07 | 3.4375 |
|