Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
|
@@ -77,3 +77,17 @@ the NPU compute itself is the table above.
|
|
| 77 |
- Source model: [`OpenGVLab/InternVL3_5-1B`](https://huggingface.co/OpenGVLab/InternVL3_5-1B)
|
| 78 |
(InternViT-300M + Qwen3-0.6B), exported and compiled with QAIRT 2.45 for
|
| 79 |
`qualcomm-snapdragon-8-elite-for-galaxy`.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 77 |
- Source model: [`OpenGVLab/InternVL3_5-1B`](https://huggingface.co/OpenGVLab/InternVL3_5-1B)
|
| 78 |
(InternViT-300M + Qwen3-0.6B), exported and compiled with QAIRT 2.45 for
|
| 79 |
`qualcomm-snapdragon-8-elite-for-galaxy`.
|
| 80 |
+
|
| 81 |
+
## v81 (SM8850 / soc_model 87)
|
| 82 |
+
|
| 83 |
+
Device-validated on SM8850: image->caption tracks the image — e.g. an orange dahlia ->
|
| 84 |
+
*"The image features a close-up of a single, large, orange flower with a textured, layered appearance. The
|
| 85 |
+
flower has a circular shape with numerous petals radiating from a central point..."*. Vision 147 ms, prefill
|
| 86 |
+
TTFT 115 ms, decode 18.4 ms/tok. The v81 recipe was **completed** by reconstructing the two graphs the
|
| 87 |
+
`internvl_generate` host-op needs but the recipe lacked: a batched-prefill graph (`ivl_pf`, AR=512, GQA) and a
|
| 88 |
+
lm-head graph (`ivl_lmh`) — both gated vs the HF gold first token. All graphs f16 (f16 I/O), DLC route + O3.
|
| 89 |
+
|
| 90 |
+
### Files (`v81/`)
|
| 91 |
+
`internvl3_5-1b.json` · `ivl_enc_f16.bin` (InternViT-300M vision) · `ivl_pf_f16.bin` (batched prefill) ·
|
| 92 |
+
`ivl_dec_f16.bin` (AR=1 decode) · `ivl_lmh_f16.bin` (lm-head) · `ivl_embed_f16.bin` · `tokenizer.json` ·
|
| 93 |
+
`vlm/` (host patch/pos-embed + pixel-shuffle MLP projector weights + prompt template).
|