Masterx commited on
Commit
0c15e25
·
verified ·
1 Parent(s): c1df8fd

Add files using upload-large-folder tool

Browse files
.gitattributes CHANGED
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ encoder-model.onnx.data filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,45 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: cc-by-4.0
3
+ language:
4
+ - en
5
+ - de
6
+ - es
7
+ - fr
8
+ pipeline_tag: automatic-speech-recognition
9
+ tags:
10
+ - automatic-speech-recognition
11
+ - onnx
12
+ - directml
13
+ - nemo
14
+ - canary
15
+ base_model:
16
+ - nvidia/canary-1b-v2
17
+ ---
18
+
19
+ # NVIDIA canary-1b-v2 — DirectML-safe ONNX
20
+
21
+ ONNX export of [nvidia/canary-1b-v2](https://huggingface.co/nvidia/canary-1b-v2) whose **encoder is re-exported
22
+ in the TorchScript idiom** (`torch.onnx.export(dynamo=False)`), so the model runs on the ONNX Runtime
23
+ **DirectML EP** (and every other EP).
24
+
25
+ ## Why
26
+
27
+ istupakov's `canary-1b-v2-onnx` encoder is a torch-**dynamo** export. On the DirectML EP it is a two-sided
28
+ trap (isolated by graph bisection): dynamic shapes crash the Reshape/attention kernels
29
+ (`MLOperatorAuthorImpl.cpp:2597`, then a D3D12 device-removal `887A0020`), and forcing static shapes
30
+ fails session creation in `InferAndVerifyOutputSizes` (`:2853`) — both unfixed ORT-DML defects around
31
+ the dynamo `view` idiom (upstream onnxruntime #26826 / #26944; the DML EP is in maintenance mode).
32
+ NVIDIA's Parakeet FastConformer, exported via TorchScript, runs fine on DML — so this repo re-exports
33
+ the **same encoder** the same way.
34
+
35
+ ## What changed
36
+
37
+ - `encoder-model.onnx` (+ `encoder-model.int8.onnx`): re-exported from the `nvidia/canary-1b-v2` NeMo
38
+ checkpoint via `torch.onnx.export(dynamo=False, opset=17)`, same I/O contract as istupakov
39
+ (`audio_signal[B,128,T]`, `length[B]` → `encoder_embeddings[B,S,1024]`, `encoder_mask[B,S]`).
40
+ Numerically identical to istupakov's encoder on CPU (max|Δ| ≈ 4e-6 — export-tracer float noise).
41
+ - `decoder-model.onnx` / `decoder-model.int8.onnx` / `config.json` / `vocab.txt`: **unchanged** from
42
+ [istupakov/canary-1b-v2-onnx](https://huggingface.co/istupakov/canary-1b-v2-onnx) — the DML crash was
43
+ encoder-only; the AED decoder is byte-for-byte the same.
44
+
45
+ Produced by [WinSTT](https://github.com/dahshury/WinSTT)'s `canary_encoder_export.py`.
decoder-model.int8.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:52d83aa7aad41fbbe4f9dfcd341d784735a6eb4c6eb0d3290fc27a0d8ac39abf
3
+ size 170040374
decoder-model.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:962dc77709f31c1ed8a55a7518ff4bed7316a87c442e7c79aa3573c4bbc39a72
3
+ size 676284211
encoder-model.int8.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9c0c85ef31816281084186af1cddd4e1fc60c30babc91a41ba3b967378948c06
3
+ size 856930799
encoder-model.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a679e3b6335ea7ffb89ab6a07bd4bf68fbe27b6a302d96efe5c77882cfdf655d
3
+ size 1253086
encoder-model.onnx.data ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ce8976c45711739179ebd496a2830cc95c3b5bb9db8303714fc766273cbf9a3b
3
+ size 3284631552
vocab.txt ADDED
The diff for this file is too large to render. See raw diff