---
language:
- lus
license: apache-2.0
base_model: Qwen/Qwen2-Audio-7B
tags:
- generated_from_trainer
datasets:
- andrewbawitlung/mizonal-v3
metrics:
- wer
- cer
model-index:
- name: qwen3-asr-0.6b-mizonal3-E1-lus-v2026.06
  results:
  - task:
      name: Automatic Speech Recognition
      type: automatic-speech-recognition
    dataset:
      name: MiZonal v3
      type: andrewbawitlung/mizonal-v3
      config: default
      split: test
    metrics:
    - name: Wer
      type: wer
      value: 22.1262
    - name: Cer
      type: cer
      value: 5.2278
    - name: Real Time Factor
      type: rtf
      value: 0.0700
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# qwen3-asr-0.6b-mizonal3-E1-lus-v2026.06

This model is a fine-tuned version of [Qwen/Qwen2-Audio-7B](https://huggingface.co/Qwen/Qwen2-Audio-7B) on the **MiZonal v3** dataset. 
Note: ~1 hour of conversational speech was added to this dataset version.

It achieves the following results on the evaluation set:
- Wer: 22.1262
- Cer: 5.2278
- Real Time Factor: 0.0700

## Model description

### Experiment Configurations
This repository is part of a series of experiments. The different configurations are:
- **E1 (Baseline):** Standard training configuration.
- **E2 (Noise):** Training with background noise augmentation.
- **E3 (Speed):** Training with speed perturbation augmentation.
- **E4 (SpecAug):** Training with SpecAugment (time and frequency masking).
- **E5 (Combined):** Training with a combination of all augmentations.

### All Models in this Family
| Experiment | Hugging Face Repository |
| :--- | :--- |
| **E1 (Baseline)** | [andrewbawitlung/qwen3-asr-0.6b-mizonal3-E1-lus-v2026.06](https://huggingface.co/andrewbawitlung/qwen3-asr-0.6b-mizonal3-E1-lus-v2026.06) |
| **E2 (Noise)** | [andrewbawitlung/qwen3-asr-0.6b-mizonal3-E2-lus-v2026.06](https://huggingface.co/andrewbawitlung/qwen3-asr-0.6b-mizonal3-E2-lus-v2026.06) |
| **E3 (Speed)** | [andrewbawitlung/qwen3-asr-0.6b-mizonal3-E3-lus-v2026.06](https://huggingface.co/andrewbawitlung/qwen3-asr-0.6b-mizonal3-E3-lus-v2026.06) |
| **E4 (SpecAug)** | [andrewbawitlung/qwen3-asr-0.6b-mizonal3-E4-lus-v2026.06](https://huggingface.co/andrewbawitlung/qwen3-asr-0.6b-mizonal3-E4-lus-v2026.06) |
| **E5 (Combined)** | [andrewbawitlung/qwen3-asr-0.6b-mizonal3-E5-lus-v2026.06](https://huggingface.co/andrewbawitlung/qwen3-asr-0.6b-mizonal3-E5-lus-v2026.06) |

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 2e-05
- train_batch_size: 16
- eval_batch_size: 8
- seed: 42
- optimizer: OptimizerNames.ADAMW_TORCH_FUSED
- lr_scheduler_type: SchedulerType.LINEAR
- num_epochs: 8

### Training results

| step | epoch | train_loss | eval_loss | eval_wer | eval_cer | learning_rate | grad_norm |
| --- | --- | --- | --- | --- | --- | --- | --- |
| 200 | 0.36429872495446264 | 0.3531 | 0.5678281188011169 | 0.42064804904154907 | 0.10793044953350296 | 1.9484200743494427e-05 | 11.4375 |
| 400 | 0.7285974499089253 | 0.2215 | 0.38337236642837524 | 0.3034932373260679 | 0.07453350296861748 | 1.855483271375465e-05 | 9.125 |
| 600 | 1.092896174863388 | 0.1323 | 0.33564406633377075 | 0.2659336382212708 | 0.06248232965790218 | 1.762546468401487e-05 | 8.75 |
| 800 | 1.4571948998178508 | 0.1034 | 0.3069060146808624 | 0.24978106451299018 | 0.06009683347469607 | 1.6696096654275093e-05 | 19.875 |
| 1000 | 1.8214936247723132 | 0.1023 | 0.2834382951259613 | 0.22983360902987254 | 0.053894543398360195 | 1.5766728624535318e-05 | 4.03125 |
| 1200 | 2.185792349726776 | 0.0753 | 0.2766484320163727 | 0.22370341539359737 | 0.051509047215154084 | 1.483736059479554e-05 | 5.625 |
| 1400 | 2.5500910746812386 | 0.0566 | 0.27566370368003845 | 0.21134572346015373 | 0.04871713316369805 | 1.3907992565055763e-05 | 4.71875 |
| 1600 | 2.9143897996357016 | 0.0573 | 0.2684209942817688 | 0.2139729493042717 | 0.0496006502685892 | 1.2978624535315987e-05 | 4.875 |
| 1800 | 3.278688524590164 | 0.037 | 0.28212207555770874 | 0.2136810353215919 | 0.050378145320893415 | 1.204925650557621e-05 | 3.75 |
| 2000 | 3.6429872495446265 | 0.0337 | 0.2878636121749878 | 0.20842658363335603 | 0.048699462821600224 | 1.111988847583643e-05 | 4.03125 |
| 2200 | 4.007285974499089 | 0.039 | 0.2856166362762451 | 0.23752067724043982 | 0.08289157478088775 | 1.0190520446096654e-05 | 5.4375 |
| 2400 | 4.371584699453552 | 0.0189 | 0.30527880787849426 | 0.21115111413836724 | 0.05044882668928471 | 9.261152416356878e-06 | 2.84375 |
| 2600 | 4.735883424408015 | 0.0178 | 0.3008843958377838 | 0.21280529337355258 | 0.05085524455753463 | 8.331784386617101e-06 | 2.6875 |
| 2800 | 5.100182149362477 | 0.0101 | 0.3245539367198944 | 0.21280529337355258 | 0.05157972858354538 | 7.402416356877325e-06 | 2.140625 |
| 3000 | 5.46448087431694 | 0.0122 | 0.3235035240650177 | 0.21407025396516494 | 0.05188012439920837 | 6.4730483271375465e-06 | 2.40625 |
| 3200 | 5.828779599271402 | 0.0102 | 0.32762861251831055 | 0.21173494210372676 | 0.05073155216284987 | 5.54368029739777e-06 | 2.1875 |
| 3400 | 6.193078324225866 | 0.0059 | 0.33911389112472534 | 0.21338912133891214 | 0.05253392705682782 | 4.614312267657993e-06 | 0.96875 |
| 3600 | 6.557377049180328 | 0.0074 | 0.341426283121109 | 0.2139729493042717 | 0.052198190556969185 | 3.684944237918216e-06 | 1.1484375 |
| 3800 | 6.9216757741347905 | 0.0084 | 0.3391820788383484 | 0.21037267685122119 | 0.05156205824144756 | 2.755576208178439e-06 | 2.125 |
| 4000 | 7.285974499089253 | 0.0079 | 0.34474754333496094 | 0.21309720735623236 | 0.051897794741306194 | 1.8262081784386618e-06 | 1.7421875 |
| 4200 | 7.6502732240437155 | 0.0082 | 0.34566405415534973 | 0.2145567772696312 | 0.052109838846480065 | 8.968401486988849e-07 | 3.4375 |