replace audio sample, update overview in readme.md
Browse files- README.md +4 -5
- assets/original.wav +2 -2
- assets/reconstructed_24k.wav +2 -2
- assets/reconstructed_48k.wav +2 -2
- assets/spectrogram_comparison.png +2 -2
README.md
CHANGED
|
@@ -21,7 +21,7 @@ Sample audio encoded with `Qwen/Qwen3-TTS-Tokenizer-12Hz` and decoded with both
|
|
| 21 |
|
| 22 |
| | Audio |
|
| 23 |
|---|---|
|
| 24 |
-
| Original<br/>[
|
| 25 |
| Reconstructed 24 kHz (base model) | <audio controls><source src="https://huggingface.co/takuma104/Qwen3-TTS-Tokenizer-12Hz-48kHz/resolve/main/assets/reconstructed_24k.wav" type="audio/wav"></audio> |
|
| 26 |
| Reconstructed 48 kHz (this model) | <audio controls><source src="https://huggingface.co/takuma104/Qwen3-TTS-Tokenizer-12Hz-48kHz/resolve/main/assets/reconstructed_48k.wav" type="audio/wav"></audio> |
|
| 27 |
|
|
@@ -31,9 +31,7 @@ Sample audio encoded with `Qwen/Qwen3-TTS-Tokenizer-12Hz` and decoded with both
|
|
| 31 |
|
| 32 |
## Overview
|
| 33 |
|
| 34 |
-
|
| 35 |
-
|
| 36 |
-
Because the modification is purely a config change (`upsample_rates: [8,5,4,3] → [8,5,4,3,2]`), the model retains the standard `model_type: qwen3_tts_tokenizer_12hz` and can be loaded with the upstream `transformers` library without `trust_remote_code=True`.
|
| 37 |
|
| 38 |
**Key properties:**
|
| 39 |
|
|
@@ -145,7 +143,8 @@ The three new modules at the end (~95K parameters) are randomly initialized. The
|
|
| 145 |
|
| 146 |
## Training Code
|
| 147 |
|
| 148 |
-
https://github.com/takuma104/Qwen3-TTS-Experimental/blob/decoder_block_48k/finetuning/decoder_block_48k/train_gan.sh
|
|
|
|
| 149 |
|
| 150 |
## Training Logs
|
| 151 |
|
|
|
|
| 21 |
|
| 22 |
| | Audio |
|
| 23 |
|---|---|
|
| 24 |
+
| Original<br/>[Hi-Fi-CAPTAIN (CC BY-NC-SA 4.0)](https://ast-astrec.nict.go.jp/release/hi-fi-captain/) | <audio controls><source src="https://huggingface.co/takuma104/Qwen3-TTS-Tokenizer-12Hz-48kHz/resolve/main/assets/original.wav" type="audio/wav"></audio> |
|
| 25 |
| Reconstructed 24 kHz (base model) | <audio controls><source src="https://huggingface.co/takuma104/Qwen3-TTS-Tokenizer-12Hz-48kHz/resolve/main/assets/reconstructed_24k.wav" type="audio/wav"></audio> |
|
| 26 |
| Reconstructed 48 kHz (this model) | <audio controls><source src="https://huggingface.co/takuma104/Qwen3-TTS-Tokenizer-12Hz-48kHz/resolve/main/assets/reconstructed_48k.wav" type="audio/wav"></audio> |
|
| 27 |
|
|
|
|
| 31 |
|
| 32 |
## Overview
|
| 33 |
|
| 34 |
+
In the HuggingFace ecosystem, model weights are always distributed with a `config.json` that defines the architecture; `transformers` dynamically instantiates the model graph from these parameters before loading the weights — and Qwen3-TTS fully adheres to this convention. Its 12 Hz codec decoder performs 1920× upsampling (12.5 Hz × 1920 = 24 kHz) governed by the `upsample_rates` list in `config.json`. This 48 kHz variant achieves double the output sample rate purely by appending `2` to that list (`[8, 5, 4, 3] → [8, 5, 4, 3, 2]`), letting `transformers` instantiate one additional `DecoderBlock` at load time — no code changes required.
|
|
|
|
|
|
|
| 35 |
|
| 36 |
**Key properties:**
|
| 37 |
|
|
|
|
| 143 |
|
| 144 |
## Training Code
|
| 145 |
|
| 146 |
+
- Obsolete: [The training code for currently release model weight](https://github.com/takuma104/Qwen3-TTS-Experimental/blob/decoder_block_48k/finetuning/decoder_block_48k/train_gan.sh)
|
| 147 |
+
- New codebase: https://github.com/takuma104/Qwen3-TTS-Tokenizer-12Hz-Trainer
|
| 148 |
|
| 149 |
## Training Logs
|
| 150 |
|
assets/original.wav
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:d2a8cd996aec5926c6d24a0961f1cb9acd54a027dc440b7bfa4fc4a88b549534
|
| 3 |
+
size 520218
|
assets/reconstructed_24k.wav
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:2ec116f89139a22cb07323cbf799034be6363fe276680af0ac6b332e51d5627e
|
| 3 |
+
size 261164
|
assets/reconstructed_48k.wav
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:6ef04427a931fed062442c2e0954f634486a082be5ff6cc96995e330bfcad601
|
| 3 |
+
size 522284
|
assets/spectrogram_comparison.png
CHANGED
|
Git LFS Details
|
|
Git LFS Details
|