ttupper75035 commited on
Commit
facd76d
·
verified ·
1 Parent(s): 90f968b

Add self-describing model card (mtp-sidecar)

Browse files
Files changed (1) hide show
  1. README.md +39 -0
README.md ADDED
@@ -0,0 +1,39 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: Qwen/Qwen3.5-27B
3
+ tags:
4
+ - mtp-sidecar
5
+ - skulk
6
+ - foxlight
7
+ license: apache-2.0
8
+ license_link: https://huggingface.co/Qwen/Qwen3.5-27B/blob/main/LICENSE
9
+ foxlight:
10
+ artifact_type: mtp-sidecar
11
+ source_repo: Qwen/Qwen3.5-27B
12
+ source_revision: fc05daec18b0a78c049392ed2e771dde82bdf654
13
+ target_model: Qwen/Qwen3.5-27B
14
+ extracted_with: skulk-weights-publisher 0.1.0
15
+ generated_at: '2026-06-02T23:11:34Z'
16
+ ---
17
+
18
+ # FoxlightAI/qwen3-5-27b-mtp
19
+
20
+ This repository contains an **MTP speculative-decoding sidecar** derived from [`Qwen/Qwen3.5-27B`](https://huggingface.co/Qwen/Qwen3.5-27B). It is **not a standalone model** — it provides the multi-token-prediction heads used by [Skulk](https://github.com/Foxlight-Foundation/Skulk) to speculatively decode for the target model **`Qwen/Qwen3.5-27B`**. The heads ship at full precision (**bf16, unquantized**) — they are the speculative drafter, where precision drives draft acceptance — so there is **one sidecar per base model** and it serves **every quantization** of the target.
21
+
22
+ ## Provenance
23
+
24
+ | Field | Value |
25
+ | --- | --- |
26
+ | Artifact type | mtp-sidecar |
27
+ | Source model | `Qwen/Qwen3.5-27B` |
28
+ | Source revision | `fc05daec18b0a78c049392ed2e771dde82bdf654` |
29
+ | Target model | `Qwen/Qwen3.5-27B` |
30
+ | Extracted with | skulk-weights-publisher `0.1.0` |
31
+ | Generated | 2026-06-02T23:11:34Z |
32
+
33
+ ## Usage
34
+
35
+ Skulk loads this sidecar (`mtp.safetensors`) alongside the target model to enable MTP speculative decoding. It is referenced from the Skulk Weights Publisher catalog and fetched automatically by the Skulk shard downloader; it is not intended to be loaded standalone.
36
+
37
+ ## License
38
+
39
+ This artifact is derived from [`Qwen/Qwen3.5-27B`](https://huggingface.co/Qwen/Qwen3.5-27B) and is published under that model's original license (**apache-2.0**), preserved unchanged. Refer to the source model's card for the full terms.