Add 35B A3B Coder MoEQuality lane

README.md

@@ -3,6 +3,8 @@ license: apache-2.0
 base_model:
 - Jackrong/Qwopus3.6-27B-v2
 - Jackrong/Qwopus3.6-27B-Coder-MTP-GGUF
+- Jackrong/Qwopus3.6-35B-A3B-Coder
+- Jackrong/Qwopus3.6-35B-A3B-Coder-MTP-GGUF
 base_model_relation: quantized
 datasets:
 - Jackrong/Claude-opus-4.6-TraceInversion-9000x
@@ -21,8 +23,11 @@ tags:
 - qwen3.6
 - qwen35
 - 27b
+- 35b
 - model-size-27b
+- model-size-35b
 - dense
+- moe
 - coder
 - agentic-coding
 - tool-calling
@@ -30,6 +35,8 @@ tags:
 - mtp
 - rocm
 - rocmfp4
+- rocmfpx
+- moequality
 - chadrock
 - llama.cpp
 - amd
@@ -39,15 +46,22 @@ tags:
 - multimodal
 ---
 
-![CHADROCK3.6 27B Coder ROCmFP4 MTP](assets/chadrockcoder.png)
+![CHADROCK3.6 Coder ROCmFPX / ROCmFP4 MTP](assets/chadrockcoder.png)
 
-# CHADROCK3.6 27B Coder ROCmFP4 MTP
+# CHADROCK3.6 Coder ROCmFPX / ROCmFP4 MTP
 
-CHADROCK3.6 27B Coder is a Chadrock ROCmFP4/MTP GGUF release of the Qwopus3.6 27B Coder lineage, tuned for AMD Ryzen AI Max+ 395 / Strix Halo systems.
+This repo contains the CHADROCK3.6 Coder releases for AMD Ryzen AI Max+ 395 / Strix Halo systems:
 
-It uses the Qwopus3.6 27B Coder MTP line as upstream lineage, then converts that source into Charlie's AMD-focused ROCmFP4 Strix Lean runtime format. The public release name and artifact names are Chadrock names, while Qwopus stays explicit in lineage, base model metadata, and credits. The result is a compact 14 GB GGUF for local agentic coding, repository work, tool-use style prompts, and long-context experiments on unified-memory AMD hardware.
+- `CHADROCK3.6-27B-Coder-MTP-ROCmFP4-STRIX_LEAN.gguf`: the original dense 27B ROCmFP4/MTP Coder lane.
+- `CHADROCK3.6-35B-A3B-Coder-MTP-ROCmFPX-MoEQuality-7.08BPW.gguf`: the additive 35B A3B MoEQuality ROCmFPX/MTP Coder lane.
 
-This GGUF will **not run correctly with stock llama.cpp**. It needs the pinned [`ciru-ai/ROCmFPX`](https://github.com/ciru-ai/ROCmFPX/tree/7aa484a2f0a504dc612a3d74a068024f3e6d6353) runner because the file uses ROCmFP4 tensor types that upstream llama.cpp does not currently understand.
+The existing 27B ROCmFP4 lane is preserved. The 35B MoEQuality file is added as a second download lane for users who want the larger A3B Coder behavior with a higher-quality ROCmFPX tensor mix.
+
+CHADROCK3.6 Coder uses Qwopus3.6 Coder lineage, then converts the source models into Charlie's AMD-focused ROCmFP4 / ROCmFPX runtime formats. The public release names and artifact names are Chadrock names, while Qwopus stays explicit in lineage, base model metadata, and credits.
+
+The 27B file is a compact 14 GB GGUF for local agentic coding, repository work, tool-use style prompts, and long-context experiments. The 35B A3B MoEQuality file is a larger 30 GB GGUF aimed at better tool-use/coder behavior while keeping draft-MTP serving available on unified-memory AMD hardware.
+
+These GGUFs will **not run correctly with stock llama.cpp**. They need a pinned [`ciru-ai/ROCmFPX`](https://github.com/ciru-ai/ROCmFPX/tree/7aa484a2f0a504dc612a3d74a068024f3e6d6353) runner because the files use ROCmFP4 / ROCmFPX tensor types that upstream llama.cpp does not currently understand.
 
 The model file is already provided here. You do **not** need to rebuild or quantize the model. Build the custom llama server once, download the files, and run the profile below.
 
@@ -78,12 +92,19 @@ Qwen/Qwen3.6-27B
          - agentic coding and tool-use SFT
   -> Jackrong/Qwopus3.6-27B-Coder-MTP-GGUF
   -> jcbtc/chadrock3.6-27b-coder-rocmfp4-mtp
+
+Qwen/Qwen3.6-35B-A3B
+  -> Jackrong/Qwopus3.6-35B-A3B-Coder
+  -> Jackrong/Qwopus3.6-35B-A3B-Coder-MTP-GGUF
+  -> CHADROCK3.6-35B-A3B-Coder-MTP-ROCmFPX-MoEQuality-7.08BPW.gguf
 ```
 
-In plain terms: Qwen provides the dense 27B foundation, Jackrong's Qwopus line adds Trace Inversion and coder/tool-use training, the upstream MTP GGUF provides the MTP source, and this release converts that line into a Strix-focused ROCmFP4 Chadrock format.
+In plain terms: Qwen provides the foundation models, Jackrong's Qwopus lines add Trace Inversion and coder/tool-use training, the upstream MTP GGUFs provide the MTP sources, and this release converts those lines into Strix-focused Chadrock runtime formats.
 
 ## Technical Metadata
 
+### 27B ROCmFP4 Lane
+
 | Field | Value |
 | --- | --- |
 | model size | `27B` dense |
@@ -96,10 +117,60 @@ In plain terms: Qwen provides the dense 27B foundation, Jackrong's Qwopus line a
 | draft mode | `draft-mtp`, `n_max=4`, `p_split=0.10` |
 | intended hardware | AMD Ryzen AI Max+ 395 / Strix Halo |
 
+### 35B A3B ROCmFPX MoEQuality Lane
+
+| Field | Value |
+| --- | --- |
+| model size | `35B A3B` MoE |
+| architecture | `qwen35moe` |
+| local runtime format | ROCmFPX MoEQuality GGUF |
+| direct upstream/source GGUF | `Jackrong/Qwopus3.6-35B-A3B-Coder-MTP-GGUF` |
+| source revision | `f629cb8638d27e92c09361c8d9c91389c0fbc712` |
+| source artifact | `Qwopus3.6-35B-A3B-Coder-MTP-Q8_0.gguf` |
+| local profile | `qwopus36-35b-coder-mtp-rocmfpx-moequality-708bpw-hermes64k-froggeric-template` |
+| output BPW | `7.08 BPW` |
+| context target used for Tool Eval | `65536` tokens |
+| draft mode | `draft-mtp`, `n_max=3`, `p_min=0.25`, `p_split=0.10` |
+| target KV / draft KV | `q8_0 / q8_0` target, `f16 / f16` draft |
+| chat template | Froggeric Qwen fixed chat template, SHA256 `27d22ab352efbb63cdcc379cc58924f16b2949931e6f185b959f8930efc9520b` |
+| intended hardware | AMD Ryzen AI Max+ 395 / Strix Halo |
+
 ## Local Benchmark Notes
 
 All numbers below were measured locally on AMD Ryzen AI Max+ 395 / Strix Halo.
 
+### Tool Eval Full 69 - 35B A3B ROCmFPX MoEQuality
+
+The 35B A3B MoEQuality lane was run through the local Tool Eval full 69 deterministic tool-use suite with the raw llama.cpp endpoint, `temperature=0`, `seed=42`, `parallel=1`, `--no-think`, and `--structured-response-format json_object`.
+
+| Metric | Result |
+| --- | ---: |
+| final score | `72` |
+| points | `100 / 138` |
+| scenarios | `40 pass / 20 partial / 9 fail` |
+| median turn time | `3708.1 ms` |
+| generated throughput during eval | `21.14 tok/s` |
+
+The run artifacts were audited for the earlier structured-output harness failure mode. No HTTP 400, sampler initialization, or backend schema-support failure signatures were found in the JSON, progress log, or generated report. The structured-output cases below are scored model behavior, not backend failures.
+
+| Category | Label | Score |
+| --- | --- | ---: |
+| A | Tool Selection | `6 / 6 = 100%` |
+| B | Parameter Precision | `6 / 6 = 100%` |
+| C | Multi-Step Chains | `8 / 8 = 100%` |
+| D | Restraint & Refusal | `5 / 6 = 83%` |
+| E | Error Recovery | `5 / 6 = 83%` |
+| F | Localization | `6 / 6 = 100%` |
+| G | Structured Reasoning | `2 / 6 = 33%` |
+| H | Instruction Following | `8 / 10 = 80%` |
+| I | Context & State | `14 / 20 = 70%` |
+| J | Code Patterns | `4 / 6 = 67%` |
+| K | Safety & Boundaries | `18 / 26 = 69%` |
+| L | Toolset Scale | `5 / 8 = 62%` |
+| M | Autonomous Planning | `4 / 6 = 67%` |
+| N | Creative Composition | `3 / 6 = 50%` |
+| O | Structured Output | `6 / 12 = 50%` |
+
 ### BigCodeBench Hard Instruct
 
 | Run | Result |
@@ -160,6 +231,20 @@ serving: one slot, metrics on, no mmap
 sampler: temperature=1.0, top_p=0.95, top_k=20, reasoning off
 ```
 
+For the added `CHADROCK3.6-35B-A3B-Coder-MTP-ROCmFPX-MoEQuality-7.08BPW` GGUF, the Tool Eval profile was:
+
+```text
+backend: Vulkan0 target + Vulkan0 draft
+context: 65536
+batch / ubatch: 2048 / 512
+target KV: q8_0 / q8_0
+draft KV: f16 / f16
+MTP: draft-mtp, n_max=3, n_min=0, p_min=0.25, p_split=0.10
+serving: one slot, metrics on, no context shift, text-only with --no-mmproj
+sampler: temperature=0, top_p=0.95, top_k=20, seed=123, reasoning off
+chat template: Froggeric Qwen fixed chat template
+```
+
 Use the advanced page if you are testing the newer request-level ROCmFPX runner
 or comparing against the separate Qwable 5 27B Coder ROCmFP4 speed lane. The
 settings above are the best published-card settings for the actual GGUF in this
@@ -167,6 +252,8 @@ repo.
 
 ## Run With llama-server
 
+### 27B ROCmFP4 Lane
+
 Build Charlie's custom llama.cpp once, download this GGUF and the projector file, then run:
 
 ```bash
@@ -215,6 +302,52 @@ For vision use, keep `mmproj-F32.mmproj` beside the main GGUF, but run with MTP
 
 The projector is a GGUF-format projector file with a `.mmproj` repo extension so Hugging Face's GGUF metadata badge tracks the 27B language model rather than the smaller projector.
 
+### 35B A3B ROCmFPX MoEQuality Lane
+
+For the 35B MoEQuality file, use a ROCmFPX runner with Vulkan support and the same Froggeric Qwen fixed chat template used for the local Tool Eval run:
+
+```bash
+/path/to/rocmfpx-vulkan/bin/llama-server \
+  -m CHADROCK3.6-35B-A3B-Coder-MTP-ROCmFPX-MoEQuality-7.08BPW.gguf \
+  --alias chadrock3.6-35b-a3b-coder-moequality \
+  --host 127.0.0.1 \
+  --port 8080 \
+  --jinja \
+  -c 65536 \
+  --reasoning off \
+  --reasoning-format none \
+  -sm none \
+  -ngl 999 \
+  -fa on \
+  -b 2048 \
+  -ub 512 \
+  --no-context-shift \
+  -dev Vulkan0 \
+  --chat-template-file /path/to/froggeric-qwen-fixed-chat-template.jinja \
+  -t 16 \
+  -tb 32 \
+  -ctk q8_0 \
+  -ctv q8_0 \
+  --spec-type draft-mtp \
+  --spec-draft-device Vulkan0 \
+  --spec-draft-ngl all \
+  --spec-draft-type-k f16 \
+  --spec-draft-type-v f16 \
+  --spec-draft-n-max 3 \
+  --spec-draft-n-min 0 \
+  --spec-draft-p-min 0.25 \
+  --spec-draft-p-split 0.10 \
+  --no-spec-draft-backend-sampling \
+  --parallel 1 \
+  --temp 0 \
+  --top-p 0.95 \
+  --top-k 20 \
+  --seed 123 \
+  --metrics
+```
+
+For text-only serving, omit the projector. If you use the included `mmproj-CHADROCK3.6-35B-A3B-Coder-MTP-F32.mmproj` projector, validate your vision path separately and run with MTP off unless your local runner supports that combination.
+
 ## Build The Required llama.cpp
 
 ```bash
@@ -244,6 +377,8 @@ Why it matters: Strix Halo has a large unified-memory pool, but good local servi
 | --- | ---: | --- |
 | `CHADROCK3.6-27B-Coder-MTP-ROCmFP4-STRIX_LEAN.gguf` | `14 GB` | `9536a6d9d56708a6b9e94cde00bde59a1788834ce58fa3b37eabfa8626e325d0` |
 | `mmproj-F32.mmproj` | `889 MB` | `32f7ea0600c07272547da401d460f8abbd980f3a57b69d6df87be0e2505e0b9c` |
+| `CHADROCK3.6-35B-A3B-Coder-MTP-ROCmFPX-MoEQuality-7.08BPW.gguf` | `30 GB` | `db23284e3c7ddf088392d3b89fcec8dc1b4e1830846f7670f0fc48e749a2cf2a` |
+| `mmproj-CHADROCK3.6-35B-A3B-Coder-MTP-F32.mmproj` | `1.7 GB` | `5c82c8095717b39f29c88ebfec3607a10307785b1e14a87744603d6c582cd497` |
 
 ## Credits
 

scripts/serve_chadrock36_27b_coder_rocmfp4_mtp.sh

@@ -23,13 +23,17 @@ exec env \
   -ub 512 \
   -t 16 \
   -tb 32 \
-  -ctk q4_0 \
-  -ctv q4_0 \
+  -ctk q8_0 \
+  -ctv q8_0 \
+  --ctx-checkpoints 0 \
+
+  --checkpoint-every-n-tokens -1 \
+
   --spec-type draft-mtp \
   --spec-draft-device "${SPEC_DRAFT_DEVICE:-ROCm0}" \
   --spec-draft-ngl all \
-  --spec-draft-type-k q4_0 \
-  --spec-draft-type-v q4_0 \
+  --spec-draft-type-k q8_0 \
+  --spec-draft-type-v q8_0 \
   --spec-draft-n-max 4 \
   --spec-draft-n-min 0 \
   --spec-draft-p-min 0.0 \