Update README.md
Browse files- README.md +15 -11
- cpp/README.md +4 -4
README.md
CHANGED
|
@@ -18,8 +18,8 @@ ZipVoice Distill 是 ZipVoice 的蒸馏版本,主要优势是在较小性能
|
|
| 18 |
|
| 19 |
### Distill 模型 (num_step=4)
|
| 20 |
|
| 21 |
-
| 场景 | 音频 | Python AX650 | C++ AX650 | C++ AXCL |
|
| 22 |
-
|------|------|-------------|-----------|----------|
|
| 23 |
| 中文句子 | 6.41s | 1.992s / 0.311 | 1.057s / 0.165 | 0.918s / **0.143** |
|
| 24 |
| 中文段落 | 44.97s | 13.457s / 0.301 | 7.357s / 0.164 | 6.443s / **0.143** |
|
| 25 |
| 英文句子 | 6.41s | 2.045s / 0.319 | 1.067s / 0.166 | 0.919s / **0.143** |
|
|
@@ -27,23 +27,22 @@ ZipVoice Distill 是 ZipVoice 的蒸馏版本,主要优势是在较小性能
|
|
| 27 |
|
| 28 |
### 普通模型 (num_step=10)
|
| 29 |
|
| 30 |
-
| 场景 | 音频 | Python AX650 | C++ AX650 | C++ AXCL |
|
| 31 |
-
|------|------|-------------|-----------|----------|
|
| 32 |
| 中文句子 | 6.41s | 5.781s / 0.902 | 5.709s / 0.891 | 5.452s / **0.850** |
|
| 33 |
| 中文段落 | 44.97s | 40.292s / 0.901 | 39.714s / 0.883 | 38.138s / **0.848** |
|
| 34 |
| 英文句子 | 6.41s | 5.711s / 0.891 | 5.693s / 0.888 | 5.447s / **0.850** |
|
| 35 |
| 英文段落 | 59.16s | 62.161s / 0.960 | 56.759s / 0.957 | 54.451s / **0.920** |
|
| 36 |
|
| 37 |
-
## Python
|
| 38 |
|
| 39 |
-
##
|
| 40 |
|
| 41 |
模型量化参考:
|
| 42 |
|
| 43 |
- [Pulsar2 Docs — How to Convert ONNX to axmodel](https://pulsar2-docs.readthedocs.io/en/latest/pulsar2/introduction.html)
|
| 44 |
- [export / quantization Project](https://github.com/AXERA-TECH/ZipVoice.AXERA)
|
| 45 |
|
| 46 |
-
##
|
| 47 |
|
| 48 |
- AX650
|
| 49 |
- AX650 demo 板
|
|
@@ -51,10 +50,10 @@ ZipVoice Distill 是 ZipVoice 的蒸馏版本,主要优势是在较小性能
|
|
| 51 |
- [M.2 Accelerator Card](https://docs.m5stack.com/zh_CN/ai_hardware/LLM-8850_Card)
|
| 52 |
|
| 53 |
|
| 54 |
-
##
|
| 55 |
|
| 56 |
```text
|
| 57 |
-
ZipVoice.
|
| 58 |
├── assets/
|
| 59 |
│ ├── moss_prompts/
|
| 60 |
│ └── paragraphs/
|
|
@@ -65,16 +64,21 @@ ZipVoice.AXERA/
|
|
| 65 |
├── resources/
|
| 66 |
│ ├── vocos-mel-24khz/
|
| 67 |
│ └── zipvoice_hf/
|
|
|
|
| 68 |
├── scripts/
|
| 69 |
-
├── infer_zipvoice_axera.py
|
|
|
|
|
|
|
| 70 |
├── requirements.txt
|
| 71 |
└── README.md
|
| 72 |
```
|
| 73 |
|
|
|
|
|
|
|
| 74 |
### 环境
|
| 75 |
|
| 76 |
安装 pyaxengine:
|
| 77 |
-
|
| 78 |
```bash
|
| 79 |
pip3 install axengine-x.x.x-py3-none-any.whl
|
| 80 |
```
|
|
|
|
| 18 |
|
| 19 |
### Distill 模型 (num_step=4)
|
| 20 |
|
| 21 |
+
| 场景 | 音频时长 | Python AX650 (耗时/RTF) | C++ AX650 (耗时/RTF) | C++ AXCL (耗时/RTF) |
|
| 22 |
+
|------|---------|------------------------|---------------------|---------------------|
|
| 23 |
| 中文句子 | 6.41s | 1.992s / 0.311 | 1.057s / 0.165 | 0.918s / **0.143** |
|
| 24 |
| 中文段落 | 44.97s | 13.457s / 0.301 | 7.357s / 0.164 | 6.443s / **0.143** |
|
| 25 |
| 英文句子 | 6.41s | 2.045s / 0.319 | 1.067s / 0.166 | 0.919s / **0.143** |
|
|
|
|
| 27 |
|
| 28 |
### 普通模型 (num_step=10)
|
| 29 |
|
| 30 |
+
| 场景 | 音频时长 | Python AX650 (耗时/RTF) | C++ AX650 (耗时/RTF) | C++ AXCL (耗时/RTF) |
|
| 31 |
+
|------|---------|------------------------|---------------------|---------------------|
|
| 32 |
| 中文句子 | 6.41s | 5.781s / 0.902 | 5.709s / 0.891 | 5.452s / **0.850** |
|
| 33 |
| 中文段落 | 44.97s | 40.292s / 0.901 | 39.714s / 0.883 | 38.138s / **0.848** |
|
| 34 |
| 英文句子 | 6.41s | 5.711s / 0.891 | 5.693s / 0.888 | 5.447s / **0.850** |
|
| 35 |
| 英文段落 | 59.16s | 62.161s / 0.960 | 56.759s / 0.957 | 54.451s / **0.920** |
|
| 36 |
|
|
|
|
| 37 |
|
| 38 |
+
## 模型转换
|
| 39 |
|
| 40 |
模型量化参考:
|
| 41 |
|
| 42 |
- [Pulsar2 Docs — How to Convert ONNX to axmodel](https://pulsar2-docs.readthedocs.io/en/latest/pulsar2/introduction.html)
|
| 43 |
- [export / quantization Project](https://github.com/AXERA-TECH/ZipVoice.AXERA)
|
| 44 |
|
| 45 |
+
## 支持平台
|
| 46 |
|
| 47 |
- AX650
|
| 48 |
- AX650 demo 板
|
|
|
|
| 50 |
- [M.2 Accelerator Card](https://docs.m5stack.com/zh_CN/ai_hardware/LLM-8850_Card)
|
| 51 |
|
| 52 |
|
| 53 |
+
## 目录结构
|
| 54 |
|
| 55 |
```text
|
| 56 |
+
ZipVoice.AXERA_AXCL/
|
| 57 |
├── assets/
|
| 58 |
│ ├── moss_prompts/
|
| 59 |
│ └── paragraphs/
|
|
|
|
| 64 |
├── resources/
|
| 65 |
│ ├── vocos-mel-24khz/
|
| 66 |
│ └── zipvoice_hf/
|
| 67 |
+
├── cpp/ # C++ 源码 (AXERA & AXCL)
|
| 68 |
├── scripts/
|
| 69 |
+
├── infer_zipvoice_axera.py # Python 推理入口
|
| 70 |
+
├── run_ax650.sh # AXERA 板端一键运行
|
| 71 |
+
├── run_axcl.sh # AXCL 算力卡一键运行
|
| 72 |
├── requirements.txt
|
| 73 |
└── README.md
|
| 74 |
```
|
| 75 |
|
| 76 |
+
## Python
|
| 77 |
+
|
| 78 |
### 环境
|
| 79 |
|
| 80 |
安装 pyaxengine:
|
| 81 |
+
[pyaxengine Releases](https://github.com/AXERA-TECH/pyaxengine/releases/latest) 下载对应版本安装:
|
| 82 |
```bash
|
| 83 |
pip3 install axengine-x.x.x-py3-none-any.whl
|
| 84 |
```
|
cpp/README.md
CHANGED
|
@@ -4,8 +4,8 @@
|
|
| 4 |
|
| 5 |
### Distill 模型 (num_step=4)
|
| 6 |
|
| 7 |
-
| 场景 | 音频 | Python AX650 | C++ AX650 | C++ AXCL |
|
| 8 |
-
|------|------|-------------|-----------|----------|
|
| 9 |
| 中文句子 | 6.41s | 1.992s / 0.311 | 1.057s / 0.165 | 0.918s / **0.143** |
|
| 10 |
| 中文段落 | 44.97s | 13.457s / 0.301 | 7.357s / 0.164 | 6.443s / **0.143** |
|
| 11 |
| 英文句子 | 6.41s | 2.045s / 0.319 | 1.067s / 0.166 | 0.919s / **0.143** |
|
|
@@ -13,8 +13,8 @@
|
|
| 13 |
|
| 14 |
### 普通模型 (num_step=10)
|
| 15 |
|
| 16 |
-
| 场景 | 音频 | Python AX650 | C++ AX650 | C++ AXCL |
|
| 17 |
-
|------|------|-------------|-----------|----------|
|
| 18 |
| 中文句子 | 6.41s | 5.781s / 0.902 | 5.709s / 0.891 | 5.452s / **0.850** |
|
| 19 |
| 中文段落 | 44.97s | 40.292s / 0.901 | 39.714s / 0.883 | 38.138s / **0.848** |
|
| 20 |
| 英文句子 | 6.41s | 5.711s / 0.891 | 5.693s / 0.888 | 5.447s / **0.850** |
|
|
|
|
| 4 |
|
| 5 |
### Distill 模型 (num_step=4)
|
| 6 |
|
| 7 |
+
| 场景 | 音频时长 | Python AX650 (耗时/RTF) | C++ AX650 (耗时/RTF) | C++ AXCL (耗时/RTF) |
|
| 8 |
+
|------|---------|------------------------|---------------------|---------------------|
|
| 9 |
| 中文句子 | 6.41s | 1.992s / 0.311 | 1.057s / 0.165 | 0.918s / **0.143** |
|
| 10 |
| 中文段落 | 44.97s | 13.457s / 0.301 | 7.357s / 0.164 | 6.443s / **0.143** |
|
| 11 |
| 英文句子 | 6.41s | 2.045s / 0.319 | 1.067s / 0.166 | 0.919s / **0.143** |
|
|
|
|
| 13 |
|
| 14 |
### 普通模型 (num_step=10)
|
| 15 |
|
| 16 |
+
| 场景 | 音频时长 | Python AX650 (耗时/RTF) | C++ AX650 (耗时/RTF) | C++ AXCL (耗时/RTF) |
|
| 17 |
+
|------|---------|------------------------|---------------------|---------------------|
|
| 18 |
| 中文句子 | 6.41s | 5.781s / 0.902 | 5.709s / 0.891 | 5.452s / **0.850** |
|
| 19 |
| 中文段落 | 44.97s | 40.292s / 0.901 | 39.714s / 0.883 | 38.138s / **0.848** |
|
| 20 |
| 英文句子 | 6.41s | 5.711s / 0.891 | 5.693s / 0.888 | 5.447s / **0.850** |
|