FoolDev Claude Fable 5 commited on
Commit
8ae1e81
·
1 Parent(s): b558907

Swap base model: Qwen/Qwen3.6-35B-A3B → llmfan46 Heretic (uncensored)

Browse files

Repoint the immediate base from vanilla Qwen/Qwen3.6-35B-A3B to
llmfan46/Qwen3.6-35B-A3B-uncensored-heretic, an uncensored "Heretic"
abliteration of the same 35B-A3B MoE (qwen3_5_moe-stamped, so the Architecture
section and the bundled blob's loadability are unchanged). Mirrors the dense
sibling's swap (Thanatos-27B -> llmfan46 27B Heretic v2).

The name Janus-35B, the janus Ollama tag, the FoolDev/Janus-35B URL, and the
Claude Fable 5 teacher slot are all kept.

- README: base_model + base_model_relation: finetune; heretic/uncensored tags
(library_name: transformers kept); badge, tagline, fact line, fork paragraph,
safetensors pointer, Related-models table, Credits, and the uncensored-base
known-limitation reframed to the Heretic lineage. Qwen/Qwen3.6-35B-A3B still
credited as the upstream pre-Heretic base. Added a bundled-blob-status callout
and Heretic-GGUF / MTP-Preserved variant rows; updated the Thanatos sibling
row to its own new Heretic base.
- CITATION.cff: title, abstract, keywords, references (immediate + upstream).
- banner.svg subtitle updated; banner.png re-rasterized from the SVG.
- Bundled Janus-35B-A3B.Q4_K_M.gguf left unchanged (legacy pre-Heretic quant;
rebundle pending, documented in the README callout).

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>

Files changed (5) hide show
  1. CHANGELOG.md +27 -0
  2. CITATION.cff +18 -11
  3. README.md +25 -11
  4. banner.png +0 -0
  5. banner.svg +1 -1
CHANGELOG.md CHANGED
@@ -8,6 +8,33 @@ track the **tooling and documentation**, not the underlying base model.
8
 
9
  ## [Unreleased]
10
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
11
  ### Changed (support badge → Tokyo Night banner)
12
  - **Replaced the shields.io "Buy me a coffee" badge** in the README badge
13
  row with a custom `bmc-banner.svg` support banner, themed to match
 
8
 
9
  ## [Unreleased]
10
 
11
+ ### Changed (base swap → llmfan46 Heretic)
12
+ - **Swapped the immediate base from `Qwen/Qwen3.6-35B-A3B` (vanilla) →
13
+ [`llmfan46/Qwen3.6-35B-A3B-uncensored-heretic`](https://huggingface.co/llmfan46/Qwen3.6-35B-A3B-uncensored-heretic)**
14
+ — an uncensored "Heretic" abliteration of the same Qwen 3.6 35B-A3B MoE
15
+ (`qwen3_5_moe`-stamped like the vanilla base, so the Architecture section,
16
+ the MoE-routing framing, and the bundled blob's loadability are all
17
+ unchanged). Mirrors the dense sibling's swap (`FoolDev/Thanatos-27B` →
18
+ `llmfan46/Qwen3.6-27B-uncensored-heretic-v2`). Repo name `Janus-35B`, the
19
+ `janus` Ollama tag, the `FoolDev/Janus-35B` URL, and the Claude Fable 5
20
+ teacher slot are all unchanged.
21
+ - README: frontmatter `base_model:` + `base_model_relation: finetune`;
22
+ `heretic` / `uncensored` tags added (`library_name: transformers` kept).
23
+ Base badge, tagline, fact line (`Type: Distilled + Abliterated MoE`), fork
24
+ paragraph, safetensors pointer, Related-models table, Credits, and the
25
+ "uncensored base" known-limitation reframed to the Heretic lineage.
26
+ `Qwen/Qwen3.6-35B-A3B` is still referenced as the upstream pre-Heretic base.
27
+ Added a "Bundled blob status" callout and the Heretic-GGUF /
28
+ MTP-Preserved variant rows. The Thanatos sibling row updated to its own
29
+ new Heretic base.
30
+ - `CITATION.cff`: title, abstract, keywords, and references reframed to the
31
+ Heretic base (immediate base + upstream base both cited).
32
+ - `banner.svg` subtitle → "Qwen 3.6 Heretic · MoE 35B/3B · Fable 5";
33
+ `banner.png` re-rasterized from the updated SVG.
34
+ - **Bundled `Janus-35B-A3B.Q4_K_M.gguf` unchanged** — still the legacy
35
+ pre-Heretic Qwen quant, so it loads and behaves like vanilla Qwen 3.6
36
+ 35B-A3B until a Heretic rebundle ships (documented in the README callout).
37
+
38
  ### Changed (support badge → Tokyo Night banner)
39
  - **Replaced the shields.io "Buy me a coffee" badge** in the README badge
40
  row with a custom `bmc-banner.svg` support banner, themed to match
CITATION.cff CHANGED
@@ -1,5 +1,5 @@
1
  cff-version: 1.2.0
2
- title: "Janus-35B: A Mixture-of-Experts Distillation Wrapper for Qwen 3.6 35B-A3B"
3
  message: "If you use this model card or its accompanying files, please cite as below."
4
  type: software
5
  authors:
@@ -8,15 +8,15 @@ authors:
8
  repository-code: "https://huggingface.co/FoolDev/Janus-35B"
9
  url: "https://huggingface.co/FoolDev/Janus-35B"
10
  abstract: >-
11
- Janus-35B is a personal repackaging of the Qwen 3.6 35B-A3B
12
- mixture-of-experts base model (35B total / 3B active per token,
13
- 256 experts, 8 activated) with Claude Fable 5 in the reasoning
14
- teacher slot. The repository ships an Ollama Modelfile, the HF
15
- Ollama-bridge files (template / system / params), sampling defaults,
16
- and a bundled Q4_K_M GGUF (~19 GB) so the HF "Use this model" widget
17
- surfaces a one-liner Ollama snippet. Other quants and the upstream
18
- safetensors (Qwen/Qwen3.6-35B-A3B) are pulled from upstream on demand
19
- rather than redistributed.
20
  keywords:
21
  - qwen
22
  - qwen3.6
@@ -25,10 +25,17 @@ keywords:
25
  - distillation
26
  - reasoning
27
  - llm
 
 
28
  license: Apache-2.0
29
  references:
30
  - type: software
31
- title: "Qwen3.6-35B-A3B"
 
 
 
 
 
32
  authors:
33
  - name: Alibaba Qwen Team
34
  url: "https://huggingface.co/Qwen/Qwen3.6-35B-A3B"
 
1
  cff-version: 1.2.0
2
+ title: "Janus-35B: A Mixture-of-Experts Distillation Wrapper for llmfan46's Qwen 3.6 35B-A3B Uncensored Heretic"
3
  message: "If you use this model card or its accompanying files, please cite as below."
4
  type: software
5
  authors:
 
8
  repository-code: "https://huggingface.co/FoolDev/Janus-35B"
9
  url: "https://huggingface.co/FoolDev/Janus-35B"
10
  abstract: >-
11
+ Janus-35B is a personal repackaging of llmfan46's uncensored Heretic
12
+ abliteration of the Qwen 3.6 35B-A3B mixture-of-experts base (35B
13
+ total / 3B active per token, 256 experts, 8 activated) with Claude
14
+ Fable 5 in the reasoning teacher slot. The repository ships an Ollama
15
+ Modelfile, the HF Ollama-bridge files (template / system / params),
16
+ sampling defaults, and a bundled Q4_K_M GGUF (~19 GB) so the HF "Use
17
+ this model" widget surfaces a one-liner Ollama snippet. Other quants
18
+ and the Heretic safetensors (llmfan46/Qwen3.6-35B-A3B-uncensored-heretic)
19
+ are pulled from upstream on demand rather than redistributed.
20
  keywords:
21
  - qwen
22
  - qwen3.6
 
25
  - distillation
26
  - reasoning
27
  - llm
28
+ - heretic
29
+ - uncensored
30
  license: Apache-2.0
31
  references:
32
  - type: software
33
+ title: "Qwen3.6-35B-A3B-uncensored-heretic (immediate base)"
34
+ authors:
35
+ - name: llmfan46
36
+ url: "https://huggingface.co/llmfan46/Qwen3.6-35B-A3B-uncensored-heretic"
37
+ - type: software
38
+ title: "Qwen3.6-35B-A3B (upstream base)"
39
  authors:
40
  - name: Alibaba Qwen Team
41
  url: "https://huggingface.co/Qwen/Qwen3.6-35B-A3B"
README.md CHANGED
@@ -1,7 +1,8 @@
1
  ---
2
  license: apache-2.0
3
  base_model:
4
- - Qwen/Qwen3.6-35B-A3B
 
5
  datasets:
6
  - crownelius/Creative_Writing_ShareGPT_Enhanced
7
  - microsoft/rStar-Coder
@@ -39,6 +40,8 @@ tags:
39
  - multimodal
40
  - agent
41
  - gguf
 
 
42
  library_name: transformers
43
  pipeline_tag: image-text-to-text
44
  ---
@@ -46,7 +49,7 @@ pipeline_tag: image-text-to-text
46
  <img src="https://huggingface.co/FoolDev/Janus-35B/resolve/main/banner.svg" alt="Janus-35B banner" width="100%" />
47
 
48
  [![License](https://img.shields.io/badge/License-Apache_2.0-7aa2f7?style=flat&labelColor=1a1b26)](https://opensource.org/licenses/Apache-2.0)
49
- [![Base Model](https://img.shields.io/badge/Base-Qwen3.6--35B--A3B-bb9af7?style=flat&labelColor=1a1b26)](https://huggingface.co/Qwen/Qwen3.6-35B-A3B)
50
  [![Architecture](https://img.shields.io/badge/Arch-MoE_35B/3B_active-ff9e64?style=flat&labelColor=1a1b26)](#architecture)
51
  [![Quant](https://img.shields.io/badge/GGUF-Q4__K__M-9ece6a?style=flat&labelColor=1a1b26)](#whats-here)
52
 
@@ -54,12 +57,12 @@ pipeline_tag: image-text-to-text
54
 
55
  # Janus-35B
56
 
57
- > **Flagship Reasoning. Sparse Footprint.**
58
- > *Qwen 3.6 35B-A3B repackaged with Claude Fable 5 in the teacher slot.*
59
 
60
- **`Architecture:`** `Qwen 3.6 35B-A3B (MoE)` | **`Total Params:`** `35B` | **`Active Params:`** `3B` | **`Teacher:`** `Claude Fable 5` | **`Type:`** `Distilled MoE LLM`
61
 
62
- A personal fork of [Qwen/Qwen3.6-35B-A3B](https://huggingface.co/Qwen/Qwen3.6-35B-A3B) — a 35B-total / 3B-active mixture-of-experts multimodal model — repackaged as Janus-35B with Claude Fable 5 reasoning data in the teacher slot.
63
 
64
  ## TL;DR
65
 
@@ -95,7 +98,14 @@ and `thinking` under Capabilities. Hardware: ~38 GB RAM at default
95
  | `template`, `system`, `params` | Used by HF's Ollama bridge when users `ollama run hf.co/FoolDev/Janus-35B` directly. The bridge does **not** read `Modelfile` (see [HF Ollama docs](https://huggingface.co/docs/hub/en/ollama)); it ingests these three root-level files instead. Kept in sync with the `Modelfile`'s `TEMPLATE` / `SYSTEM` / `PARAMETER` directives. |
96
  | `scripts/check_bridge_sync.py` | Run before pushing a `Modelfile` / `template` / `system` / `params` edit to verify the four configurations remain in sync. Exits 0 if in sync, 1 with a per-key diff if not. |
97
 
98
- GGUF-only release. Pull the upstream safetensors from `Qwen/Qwen3.6-35B-A3B` if you need the `transformers` tree.
 
 
 
 
 
 
 
99
 
100
  ## Architecture
101
 
@@ -316,20 +326,24 @@ print(resp.choices[0].message.tool_calls)
316
  - **Quantization-induced quality loss.** Q4_K_M is a strong general-purpose quant but does measurably degrade math and code accuracy compared to BF16. If you need maximum quality, run the upstream safetensors on a GPU that fits BF16 (~70 GB).
317
  - **MoE expert utilization is uneven.** Stock Qwen3.6-35B-A3B routes 8 of 256 experts per token. On narrow domains (e.g. only one programming language) a small subset of experts dominates; load-balance loss was a training-time concern, not a runtime guarantee.
318
  - **Thinking traces can loop.** Like most reasoning-distilled models, Janus-35B occasionally gets stuck repeating itself inside `<think>` tags. Mitigations: lower temperature to 0.4-0.6, raise `repeat_penalty` to 1.08, or set a `<think>`-token budget cap if your loader supports it.
319
- - **Not aligned with any specific safety policy.** This is a personal repackage of an open-weight base model with reasoning-focused distillation. There is no RLHF refusal layer beyond what Qwen 3.6 ships with; downstream safety is the operator's responsibility.
320
  - **No formal evaluation in this card.** Numbers in the hardware table are estimates, not measured. If you produce real benchmarks (MMLU, HumanEval, etc.) and want them included, file a PR.
321
 
322
  ## Related models
323
 
324
  | Model | Size | Notes |
325
  |---|---|---|
326
- | [Qwen/Qwen3.6-35B-A3B](https://huggingface.co/Qwen/Qwen3.6-35B-A3B) | 35B / 3B active | Upstream base model. `transformers`-native multimodal weights. |
327
- | [FoolDev/Thanatos-27B](https://huggingface.co/FoolDev/Thanatos-27B) | 27B dense | Dense sibling on the vanilla [Qwen/Qwen3.6-27B](https://huggingface.co/Qwen/Qwen3.6-27B) base. Same teacher (Fable 5), same dataset family, smaller memory footprint, no MoE quirks. (The old `FoolDev/Thanatos-27B-Heretic` slug now serves a 307 to this path.) |
 
 
 
328
  | [Crownelius/Crow-9B-HERETIC-4.6](https://huggingface.co/Crownelius/Crow-9B-HERETIC-4.6) | 9B dense | Heretic-flavored fine-tune of the same Qwen 3.5 9B base used as a smaller starting point. Useful as a fast first-pass model when 35B is too heavy for the host. |
329
 
330
  ## Credits
331
 
332
- - Base model: [Qwen/Qwen3.6-35B-A3B](https://huggingface.co/Qwen/Qwen3.6-35B-A3B) (Alibaba)
 
333
  - Reasoning teacher: Claude Fable 5 (Anthropic)
334
  - Distillation lineage and dataset curation: [Crownelius](https://huggingface.co/Crownelius)
335
 
 
1
  ---
2
  license: apache-2.0
3
  base_model:
4
+ - llmfan46/Qwen3.6-35B-A3B-uncensored-heretic
5
+ base_model_relation: finetune
6
  datasets:
7
  - crownelius/Creative_Writing_ShareGPT_Enhanced
8
  - microsoft/rStar-Coder
 
40
  - multimodal
41
  - agent
42
  - gguf
43
+ - heretic
44
+ - uncensored
45
  library_name: transformers
46
  pipeline_tag: image-text-to-text
47
  ---
 
49
  <img src="https://huggingface.co/FoolDev/Janus-35B/resolve/main/banner.svg" alt="Janus-35B banner" width="100%" />
50
 
51
  [![License](https://img.shields.io/badge/License-Apache_2.0-7aa2f7?style=flat&labelColor=1a1b26)](https://opensource.org/licenses/Apache-2.0)
52
+ [![Base Model](https://img.shields.io/badge/Base-Heretic-bb9af7?style=flat&labelColor=1a1b26)](https://huggingface.co/llmfan46/Qwen3.6-35B-A3B-uncensored-heretic)
53
  [![Architecture](https://img.shields.io/badge/Arch-MoE_35B/3B_active-ff9e64?style=flat&labelColor=1a1b26)](#architecture)
54
  [![Quant](https://img.shields.io/badge/GGUF-Q4__K__M-9ece6a?style=flat&labelColor=1a1b26)](#whats-here)
55
 
 
57
 
58
  # Janus-35B
59
 
60
+ > **Flagship Reasoning. Sparse Footprint. Uncensored.**
61
+ > *llmfan46's Heretic abliteration of Qwen 3.6 35B-A3B, repackaged with Claude Fable 5 in the teacher slot.*
62
 
63
+ **`Architecture:`** `Qwen 3.6 35B-A3B (MoE)` | **`Total Params:`** `35B` | **`Active Params:`** `3B` | **`Base:`** `Heretic (llmfan46)` | **`Teacher:`** `Claude Fable 5` | **`Type:`** `Distilled + Abliterated MoE LLM`
64
 
65
+ A personal fork of [`llmfan46/Qwen3.6-35B-A3B-uncensored-heretic`](https://huggingface.co/llmfan46/Qwen3.6-35B-A3B-uncensored-heretic) — an uncensored Heretic-style abliteration of [Qwen/Qwen3.6-35B-A3B](https://huggingface.co/Qwen/Qwen3.6-35B-A3B), the 35B-total / 3B-active mixture-of-experts multimodal base — repackaged as Janus-35B with Claude Fable 5 reasoning data in the teacher slot. Refusal-trained behavior is dialed back at the base layer.
66
 
67
  ## TL;DR
68
 
 
98
  | `template`, `system`, `params` | Used by HF's Ollama bridge when users `ollama run hf.co/FoolDev/Janus-35B` directly. The bridge does **not** read `Modelfile` (see [HF Ollama docs](https://huggingface.co/docs/hub/en/ollama)); it ingests these three root-level files instead. Kept in sync with the `Modelfile`'s `TEMPLATE` / `SYSTEM` / `PARAMETER` directives. |
99
  | `scripts/check_bridge_sync.py` | Run before pushing a `Modelfile` / `template` / `system` / `params` edit to verify the four configurations remain in sync. Exits 0 if in sync, 1 with a per-key diff if not. |
100
 
101
+ GGUF-only release. Pull the Heretic safetensors from [`llmfan46/Qwen3.6-35B-A3B-uncensored-heretic`](https://huggingface.co/llmfan46/Qwen3.6-35B-A3B-uncensored-heretic) if you need the `transformers` tree (or the vanilla pre-Heretic base from [`Qwen/Qwen3.6-35B-A3B`](https://huggingface.co/Qwen/Qwen3.6-35B-A3B)).
102
+
103
+ > **Bundled blob status:** the `Janus-35B-A3B.Q4_K_M.gguf` shipped here is the
104
+ > legacy pre-Heretic Qwen 3.6 35B-A3B quant — it loads and behaves like vanilla
105
+ > Qwen 3.6 35B-A3B for now. A Heretic rebundle (from
106
+ > [`llmfan46/Qwen3.6-35B-A3B-uncensored-heretic-GGUF`](https://huggingface.co/llmfan46/Qwen3.6-35B-A3B-uncensored-heretic-GGUF))
107
+ > is pending; until then, pull a GGUF from that repo directly for the uncensored
108
+ > Heretic behavior.
109
 
110
  ## Architecture
111
 
 
326
  - **Quantization-induced quality loss.** Q4_K_M is a strong general-purpose quant but does measurably degrade math and code accuracy compared to BF16. If you need maximum quality, run the upstream safetensors on a GPU that fits BF16 (~70 GB).
327
  - **MoE expert utilization is uneven.** Stock Qwen3.6-35B-A3B routes 8 of 256 experts per token. On narrow domains (e.g. only one programming language) a small subset of experts dominates; load-balance loss was a training-time concern, not a runtime guarantee.
328
  - **Thinking traces can loop.** Like most reasoning-distilled models, Janus-35B occasionally gets stuck repeating itself inside `<think>` tags. Mitigations: lower temperature to 0.4-0.6, raise `repeat_penalty` to 1.08, or set a `<think>`-token budget cap if your loader supports it.
329
+ - **Uncensored base — not aligned with any specific safety policy.** This is a personal repackage of an open-weight base whose refusal behavior has been abliterated away (the llmfan46 Heretic base). There is no RLHF refusal layer; the model will attempt most requests, so downstream safety is entirely the operator's responsibility.
330
  - **No formal evaluation in this card.** Numbers in the hardware table are estimates, not measured. If you produce real benchmarks (MMLU, HumanEval, etc.) and want them included, file a PR.
331
 
332
  ## Related models
333
 
334
  | Model | Size | Notes |
335
  |---|---|---|
336
+ | [llmfan46/Qwen3.6-35B-A3B-uncensored-heretic](https://huggingface.co/llmfan46/Qwen3.6-35B-A3B-uncensored-heretic) | 35B / 3B active | **Immediate base.** Uncensored Heretic abliteration of Qwen 3.6 35B-A3B; `transformers`-native safetensors. |
337
+ | [llmfan46/Qwen3.6-35B-A3B-uncensored-heretic-GGUF](https://huggingface.co/llmfan46/Qwen3.6-35B-A3B-uncensored-heretic-GGUF) | 35B / 3B active | Heretic GGUFs pull one here for the uncensored behavior until the bundled blob is rebundled. |
338
+ | [llmfan46/Qwen3.6-35B-A3B-uncensored-heretic-Native-MTP-Preserved](https://huggingface.co/llmfan46/Qwen3.6-35B-A3B-uncensored-heretic-Native-MTP-Preserved) | 35B / 3B active | Same Heretic base but keeps the MTP head for vLLM / SGLang speculative decoding. |
339
+ | [Qwen/Qwen3.6-35B-A3B](https://huggingface.co/Qwen/Qwen3.6-35B-A3B) | 35B / 3B active | Upstream pre-Heretic base model. `transformers`-native multimodal weights. |
340
+ | [FoolDev/Thanatos-27B](https://huggingface.co/FoolDev/Thanatos-27B) | 27B dense | Dense sibling on the [`llmfan46/Qwen3.6-27B-uncensored-heretic-v2`](https://huggingface.co/llmfan46/Qwen3.6-27B-uncensored-heretic-v2) Heretic base. Same teacher (Fable 5), same dataset family, smaller memory footprint, no MoE quirks. (The old `FoolDev/Thanatos-27B-Heretic` slug now serves a 307 to this path.) |
341
  | [Crownelius/Crow-9B-HERETIC-4.6](https://huggingface.co/Crownelius/Crow-9B-HERETIC-4.6) | 9B dense | Heretic-flavored fine-tune of the same Qwen 3.5 9B base used as a smaller starting point. Useful as a fast first-pass model when 35B is too heavy for the host. |
342
 
343
  ## Credits
344
 
345
+ - Immediate base: [llmfan46/Qwen3.6-35B-A3B-uncensored-heretic](https://huggingface.co/llmfan46/Qwen3.6-35B-A3B-uncensored-heretic) — Heretic-style abliteration of Qwen 3.6 35B-A3B
346
+ - Upstream base: [Qwen/Qwen3.6-35B-A3B](https://huggingface.co/Qwen/Qwen3.6-35B-A3B) (Alibaba)
347
  - Reasoning teacher: Claude Fable 5 (Anthropic)
348
  - Distillation lineage and dataset curation: [Crownelius](https://huggingface.co/Crownelius)
349
 
banner.png CHANGED
banner.svg CHANGED