Instructions to use FoolDev/Janus-35B-HERETIC with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use FoolDev/Janus-35B-HERETIC with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("image-text-to-text", model="FoolDev/Janus-35B-HERETIC") messages = [ { "role": "user", "content": [ {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"}, {"type": "text", "text": "What animal is on the candy?"} ] }, ] pipe(text=messages)# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("FoolDev/Janus-35B-HERETIC", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use FoolDev/Janus-35B-HERETIC with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf FoolDev/Janus-35B-HERETIC:Q4_K_M # Run inference directly in the terminal: llama cli -hf FoolDev/Janus-35B-HERETIC:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf FoolDev/Janus-35B-HERETIC:Q4_K_M # Run inference directly in the terminal: llama cli -hf FoolDev/Janus-35B-HERETIC:Q4_K_M
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf FoolDev/Janus-35B-HERETIC:Q4_K_M # Run inference directly in the terminal: ./llama-cli -hf FoolDev/Janus-35B-HERETIC:Q4_K_M
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf FoolDev/Janus-35B-HERETIC:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama-cli -hf FoolDev/Janus-35B-HERETIC:Q4_K_M
Use Docker
docker model run hf.co/FoolDev/Janus-35B-HERETIC:Q4_K_M
- LM Studio
- Jan
- vLLM
How to use FoolDev/Janus-35B-HERETIC with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "FoolDev/Janus-35B-HERETIC" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "FoolDev/Janus-35B-HERETIC", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }'Use Docker
docker model run hf.co/FoolDev/Janus-35B-HERETIC:Q4_K_M
- SGLang
How to use FoolDev/Janus-35B-HERETIC with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "FoolDev/Janus-35B-HERETIC" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "FoolDev/Janus-35B-HERETIC", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "FoolDev/Janus-35B-HERETIC" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "FoolDev/Janus-35B-HERETIC", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }' - Ollama
How to use FoolDev/Janus-35B-HERETIC with Ollama:
ollama run hf.co/FoolDev/Janus-35B-HERETIC:Q4_K_M
- Unsloth Studio
How to use FoolDev/Janus-35B-HERETIC with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for FoolDev/Janus-35B-HERETIC to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for FoolDev/Janus-35B-HERETIC to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for FoolDev/Janus-35B-HERETIC to start chatting
- Pi
How to use FoolDev/Janus-35B-HERETIC with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf FoolDev/Janus-35B-HERETIC:Q4_K_M
Configure the model in Pi
# Install Pi: npm install -g @mariozechner/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "FoolDev/Janus-35B-HERETIC:Q4_K_M" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Docker Model Runner
How to use FoolDev/Janus-35B-HERETIC with Docker Model Runner:
docker model run hf.co/FoolDev/Janus-35B-HERETIC:Q4_K_M
- Lemonade
How to use FoolDev/Janus-35B-HERETIC with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull FoolDev/Janus-35B-HERETIC:Q4_K_M
Run and chat with the model
lemonade run user.Janus-35B-HERETIC-Q4_K_M
List all available models
lemonade list
- Hermes Agent
How to use FoolDev/Janus-35B-HERETIC with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf FoolDev/Janus-35B-HERETIC:Q4_K_M
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default FoolDev/Janus-35B-HERETIC:Q4_K_M
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use FoolDev/Janus-35B-HERETIC with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf FoolDev/Janus-35B-HERETIC:Q4_K_M
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "FoolDev/Janus-35B-HERETIC:Q4_K_M" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
Swap base model: Qwen/Qwen3.6-35B-A3B → llmfan46 Heretic (uncensored)
Browse filesRepoint the immediate base from vanilla Qwen/Qwen3.6-35B-A3B to
llmfan46/Qwen3.6-35B-A3B-uncensored-heretic, an uncensored "Heretic"
abliteration of the same 35B-A3B MoE (qwen3_5_moe-stamped, so the Architecture
section and the bundled blob's loadability are unchanged). Mirrors the dense
sibling's swap (Thanatos-27B -> llmfan46 27B Heretic v2).
The name Janus-35B, the janus Ollama tag, the FoolDev/Janus-35B URL, and the
Claude Fable 5 teacher slot are all kept.
- README: base_model + base_model_relation: finetune; heretic/uncensored tags
(library_name: transformers kept); badge, tagline, fact line, fork paragraph,
safetensors pointer, Related-models table, Credits, and the uncensored-base
known-limitation reframed to the Heretic lineage. Qwen/Qwen3.6-35B-A3B still
credited as the upstream pre-Heretic base. Added a bundled-blob-status callout
and Heretic-GGUF / MTP-Preserved variant rows; updated the Thanatos sibling
row to its own new Heretic base.
- CITATION.cff: title, abstract, keywords, references (immediate + upstream).
- banner.svg subtitle updated; banner.png re-rasterized from the SVG.
- Bundled Janus-35B-A3B.Q4_K_M.gguf left unchanged (legacy pre-Heretic quant;
rebundle pending, documented in the README callout).
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
- CHANGELOG.md +27 -0
- CITATION.cff +18 -11
- README.md +25 -11
- banner.png +0 -0
- banner.svg +1 -1
|
@@ -8,6 +8,33 @@ track the **tooling and documentation**, not the underlying base model.
|
|
| 8 |
|
| 9 |
## [Unreleased]
|
| 10 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 11 |
### Changed (support badge → Tokyo Night banner)
|
| 12 |
- **Replaced the shields.io "Buy me a coffee" badge** in the README badge
|
| 13 |
row with a custom `bmc-banner.svg` support banner, themed to match
|
|
|
|
| 8 |
|
| 9 |
## [Unreleased]
|
| 10 |
|
| 11 |
+
### Changed (base swap → llmfan46 Heretic)
|
| 12 |
+
- **Swapped the immediate base from `Qwen/Qwen3.6-35B-A3B` (vanilla) →
|
| 13 |
+
[`llmfan46/Qwen3.6-35B-A3B-uncensored-heretic`](https://huggingface.co/llmfan46/Qwen3.6-35B-A3B-uncensored-heretic)**
|
| 14 |
+
— an uncensored "Heretic" abliteration of the same Qwen 3.6 35B-A3B MoE
|
| 15 |
+
(`qwen3_5_moe`-stamped like the vanilla base, so the Architecture section,
|
| 16 |
+
the MoE-routing framing, and the bundled blob's loadability are all
|
| 17 |
+
unchanged). Mirrors the dense sibling's swap (`FoolDev/Thanatos-27B` →
|
| 18 |
+
`llmfan46/Qwen3.6-27B-uncensored-heretic-v2`). Repo name `Janus-35B`, the
|
| 19 |
+
`janus` Ollama tag, the `FoolDev/Janus-35B` URL, and the Claude Fable 5
|
| 20 |
+
teacher slot are all unchanged.
|
| 21 |
+
- README: frontmatter `base_model:` + `base_model_relation: finetune`;
|
| 22 |
+
`heretic` / `uncensored` tags added (`library_name: transformers` kept).
|
| 23 |
+
Base badge, tagline, fact line (`Type: Distilled + Abliterated MoE`), fork
|
| 24 |
+
paragraph, safetensors pointer, Related-models table, Credits, and the
|
| 25 |
+
"uncensored base" known-limitation reframed to the Heretic lineage.
|
| 26 |
+
`Qwen/Qwen3.6-35B-A3B` is still referenced as the upstream pre-Heretic base.
|
| 27 |
+
Added a "Bundled blob status" callout and the Heretic-GGUF /
|
| 28 |
+
MTP-Preserved variant rows. The Thanatos sibling row updated to its own
|
| 29 |
+
new Heretic base.
|
| 30 |
+
- `CITATION.cff`: title, abstract, keywords, and references reframed to the
|
| 31 |
+
Heretic base (immediate base + upstream base both cited).
|
| 32 |
+
- `banner.svg` subtitle → "Qwen 3.6 Heretic · MoE 35B/3B · Fable 5";
|
| 33 |
+
`banner.png` re-rasterized from the updated SVG.
|
| 34 |
+
- **Bundled `Janus-35B-A3B.Q4_K_M.gguf` unchanged** — still the legacy
|
| 35 |
+
pre-Heretic Qwen quant, so it loads and behaves like vanilla Qwen 3.6
|
| 36 |
+
35B-A3B until a Heretic rebundle ships (documented in the README callout).
|
| 37 |
+
|
| 38 |
### Changed (support badge → Tokyo Night banner)
|
| 39 |
- **Replaced the shields.io "Buy me a coffee" badge** in the README badge
|
| 40 |
row with a custom `bmc-banner.svg` support banner, themed to match
|
|
@@ -1,5 +1,5 @@
|
|
| 1 |
cff-version: 1.2.0
|
| 2 |
-
title: "Janus-35B: A Mixture-of-Experts Distillation Wrapper for Qwen 3.6 35B-A3B"
|
| 3 |
message: "If you use this model card or its accompanying files, please cite as below."
|
| 4 |
type: software
|
| 5 |
authors:
|
|
@@ -8,15 +8,15 @@ authors:
|
|
| 8 |
repository-code: "https://huggingface.co/FoolDev/Janus-35B"
|
| 9 |
url: "https://huggingface.co/FoolDev/Janus-35B"
|
| 10 |
abstract: >-
|
| 11 |
-
Janus-35B is a personal repackaging of
|
| 12 |
-
mixture-of-experts base
|
| 13 |
-
256 experts, 8 activated) with Claude
|
| 14 |
-
teacher slot. The repository ships an Ollama
|
| 15 |
-
Ollama-bridge files (template / system / params),
|
| 16 |
-
and a bundled Q4_K_M GGUF (~19 GB) so the HF "Use
|
| 17 |
-
surfaces a one-liner Ollama snippet. Other quants
|
| 18 |
-
safetensors (
|
| 19 |
-
rather than redistributed.
|
| 20 |
keywords:
|
| 21 |
- qwen
|
| 22 |
- qwen3.6
|
|
@@ -25,10 +25,17 @@ keywords:
|
|
| 25 |
- distillation
|
| 26 |
- reasoning
|
| 27 |
- llm
|
|
|
|
|
|
|
| 28 |
license: Apache-2.0
|
| 29 |
references:
|
| 30 |
- type: software
|
| 31 |
-
title: "Qwen3.6-35B-A3B"
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 32 |
authors:
|
| 33 |
- name: Alibaba Qwen Team
|
| 34 |
url: "https://huggingface.co/Qwen/Qwen3.6-35B-A3B"
|
|
|
|
| 1 |
cff-version: 1.2.0
|
| 2 |
+
title: "Janus-35B: A Mixture-of-Experts Distillation Wrapper for llmfan46's Qwen 3.6 35B-A3B Uncensored Heretic"
|
| 3 |
message: "If you use this model card or its accompanying files, please cite as below."
|
| 4 |
type: software
|
| 5 |
authors:
|
|
|
|
| 8 |
repository-code: "https://huggingface.co/FoolDev/Janus-35B"
|
| 9 |
url: "https://huggingface.co/FoolDev/Janus-35B"
|
| 10 |
abstract: >-
|
| 11 |
+
Janus-35B is a personal repackaging of llmfan46's uncensored Heretic
|
| 12 |
+
abliteration of the Qwen 3.6 35B-A3B mixture-of-experts base (35B
|
| 13 |
+
total / 3B active per token, 256 experts, 8 activated) with Claude
|
| 14 |
+
Fable 5 in the reasoning teacher slot. The repository ships an Ollama
|
| 15 |
+
Modelfile, the HF Ollama-bridge files (template / system / params),
|
| 16 |
+
sampling defaults, and a bundled Q4_K_M GGUF (~19 GB) so the HF "Use
|
| 17 |
+
this model" widget surfaces a one-liner Ollama snippet. Other quants
|
| 18 |
+
and the Heretic safetensors (llmfan46/Qwen3.6-35B-A3B-uncensored-heretic)
|
| 19 |
+
are pulled from upstream on demand rather than redistributed.
|
| 20 |
keywords:
|
| 21 |
- qwen
|
| 22 |
- qwen3.6
|
|
|
|
| 25 |
- distillation
|
| 26 |
- reasoning
|
| 27 |
- llm
|
| 28 |
+
- heretic
|
| 29 |
+
- uncensored
|
| 30 |
license: Apache-2.0
|
| 31 |
references:
|
| 32 |
- type: software
|
| 33 |
+
title: "Qwen3.6-35B-A3B-uncensored-heretic (immediate base)"
|
| 34 |
+
authors:
|
| 35 |
+
- name: llmfan46
|
| 36 |
+
url: "https://huggingface.co/llmfan46/Qwen3.6-35B-A3B-uncensored-heretic"
|
| 37 |
+
- type: software
|
| 38 |
+
title: "Qwen3.6-35B-A3B (upstream base)"
|
| 39 |
authors:
|
| 40 |
- name: Alibaba Qwen Team
|
| 41 |
url: "https://huggingface.co/Qwen/Qwen3.6-35B-A3B"
|
|
@@ -1,7 +1,8 @@
|
|
| 1 |
---
|
| 2 |
license: apache-2.0
|
| 3 |
base_model:
|
| 4 |
-
-
|
|
|
|
| 5 |
datasets:
|
| 6 |
- crownelius/Creative_Writing_ShareGPT_Enhanced
|
| 7 |
- microsoft/rStar-Coder
|
|
@@ -39,6 +40,8 @@ tags:
|
|
| 39 |
- multimodal
|
| 40 |
- agent
|
| 41 |
- gguf
|
|
|
|
|
|
|
| 42 |
library_name: transformers
|
| 43 |
pipeline_tag: image-text-to-text
|
| 44 |
---
|
|
@@ -46,7 +49,7 @@ pipeline_tag: image-text-to-text
|
|
| 46 |
<img src="https://huggingface.co/FoolDev/Janus-35B/resolve/main/banner.svg" alt="Janus-35B banner" width="100%" />
|
| 47 |
|
| 48 |
[](https://opensource.org/licenses/Apache-2.0)
|
| 49 |
-
[](#architecture)
|
| 51 |
[](#whats-here)
|
| 52 |
|
|
@@ -54,12 +57,12 @@ pipeline_tag: image-text-to-text
|
|
| 54 |
|
| 55 |
# Janus-35B
|
| 56 |
|
| 57 |
-
> **Flagship Reasoning. Sparse Footprint.**
|
| 58 |
-
> *Qwen 3.6 35B-A3B repackaged with Claude Fable 5 in the teacher slot.*
|
| 59 |
|
| 60 |
-
**`Architecture:`** `Qwen 3.6 35B-A3B (MoE)` | **`Total Params:`** `35B` | **`Active Params:`** `3B` | **`Teacher:`** `Claude Fable 5` | **`Type:`** `Distilled MoE LLM`
|
| 61 |
|
| 62 |
-
A personal fork of [
|
| 63 |
|
| 64 |
## TL;DR
|
| 65 |
|
|
@@ -95,7 +98,14 @@ and `thinking` under Capabilities. Hardware: ~38 GB RAM at default
|
|
| 95 |
| `template`, `system`, `params` | Used by HF's Ollama bridge when users `ollama run hf.co/FoolDev/Janus-35B` directly. The bridge does **not** read `Modelfile` (see [HF Ollama docs](https://huggingface.co/docs/hub/en/ollama)); it ingests these three root-level files instead. Kept in sync with the `Modelfile`'s `TEMPLATE` / `SYSTEM` / `PARAMETER` directives. |
|
| 96 |
| `scripts/check_bridge_sync.py` | Run before pushing a `Modelfile` / `template` / `system` / `params` edit to verify the four configurations remain in sync. Exits 0 if in sync, 1 with a per-key diff if not. |
|
| 97 |
|
| 98 |
-
GGUF-only release. Pull the
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 99 |
|
| 100 |
## Architecture
|
| 101 |
|
|
@@ -316,20 +326,24 @@ print(resp.choices[0].message.tool_calls)
|
|
| 316 |
- **Quantization-induced quality loss.** Q4_K_M is a strong general-purpose quant but does measurably degrade math and code accuracy compared to BF16. If you need maximum quality, run the upstream safetensors on a GPU that fits BF16 (~70 GB).
|
| 317 |
- **MoE expert utilization is uneven.** Stock Qwen3.6-35B-A3B routes 8 of 256 experts per token. On narrow domains (e.g. only one programming language) a small subset of experts dominates; load-balance loss was a training-time concern, not a runtime guarantee.
|
| 318 |
- **Thinking traces can loop.** Like most reasoning-distilled models, Janus-35B occasionally gets stuck repeating itself inside `<think>` tags. Mitigations: lower temperature to 0.4-0.6, raise `repeat_penalty` to 1.08, or set a `<think>`-token budget cap if your loader supports it.
|
| 319 |
-
- **
|
| 320 |
- **No formal evaluation in this card.** Numbers in the hardware table are estimates, not measured. If you produce real benchmarks (MMLU, HumanEval, etc.) and want them included, file a PR.
|
| 321 |
|
| 322 |
## Related models
|
| 323 |
|
| 324 |
| Model | Size | Notes |
|
| 325 |
|---|---|---|
|
| 326 |
-
| [
|
| 327 |
-
| [
|
|
|
|
|
|
|
|
|
|
| 328 |
| [Crownelius/Crow-9B-HERETIC-4.6](https://huggingface.co/Crownelius/Crow-9B-HERETIC-4.6) | 9B dense | Heretic-flavored fine-tune of the same Qwen 3.5 9B base used as a smaller starting point. Useful as a fast first-pass model when 35B is too heavy for the host. |
|
| 329 |
|
| 330 |
## Credits
|
| 331 |
|
| 332 |
-
-
|
|
|
|
| 333 |
- Reasoning teacher: Claude Fable 5 (Anthropic)
|
| 334 |
- Distillation lineage and dataset curation: [Crownelius](https://huggingface.co/Crownelius)
|
| 335 |
|
|
|
|
| 1 |
---
|
| 2 |
license: apache-2.0
|
| 3 |
base_model:
|
| 4 |
+
- llmfan46/Qwen3.6-35B-A3B-uncensored-heretic
|
| 5 |
+
base_model_relation: finetune
|
| 6 |
datasets:
|
| 7 |
- crownelius/Creative_Writing_ShareGPT_Enhanced
|
| 8 |
- microsoft/rStar-Coder
|
|
|
|
| 40 |
- multimodal
|
| 41 |
- agent
|
| 42 |
- gguf
|
| 43 |
+
- heretic
|
| 44 |
+
- uncensored
|
| 45 |
library_name: transformers
|
| 46 |
pipeline_tag: image-text-to-text
|
| 47 |
---
|
|
|
|
| 49 |
<img src="https://huggingface.co/FoolDev/Janus-35B/resolve/main/banner.svg" alt="Janus-35B banner" width="100%" />
|
| 50 |
|
| 51 |
[](https://opensource.org/licenses/Apache-2.0)
|
| 52 |
+
[](https://huggingface.co/llmfan46/Qwen3.6-35B-A3B-uncensored-heretic)
|
| 53 |
[](#architecture)
|
| 54 |
[](#whats-here)
|
| 55 |
|
|
|
|
| 57 |
|
| 58 |
# Janus-35B
|
| 59 |
|
| 60 |
+
> **Flagship Reasoning. Sparse Footprint. Uncensored.**
|
| 61 |
+
> *llmfan46's Heretic abliteration of Qwen 3.6 35B-A3B, repackaged with Claude Fable 5 in the teacher slot.*
|
| 62 |
|
| 63 |
+
**`Architecture:`** `Qwen 3.6 35B-A3B (MoE)` | **`Total Params:`** `35B` | **`Active Params:`** `3B` | **`Base:`** `Heretic (llmfan46)` | **`Teacher:`** `Claude Fable 5` | **`Type:`** `Distilled + Abliterated MoE LLM`
|
| 64 |
|
| 65 |
+
A personal fork of [`llmfan46/Qwen3.6-35B-A3B-uncensored-heretic`](https://huggingface.co/llmfan46/Qwen3.6-35B-A3B-uncensored-heretic) — an uncensored Heretic-style abliteration of [Qwen/Qwen3.6-35B-A3B](https://huggingface.co/Qwen/Qwen3.6-35B-A3B), the 35B-total / 3B-active mixture-of-experts multimodal base — repackaged as Janus-35B with Claude Fable 5 reasoning data in the teacher slot. Refusal-trained behavior is dialed back at the base layer.
|
| 66 |
|
| 67 |
## TL;DR
|
| 68 |
|
|
|
|
| 98 |
| `template`, `system`, `params` | Used by HF's Ollama bridge when users `ollama run hf.co/FoolDev/Janus-35B` directly. The bridge does **not** read `Modelfile` (see [HF Ollama docs](https://huggingface.co/docs/hub/en/ollama)); it ingests these three root-level files instead. Kept in sync with the `Modelfile`'s `TEMPLATE` / `SYSTEM` / `PARAMETER` directives. |
|
| 99 |
| `scripts/check_bridge_sync.py` | Run before pushing a `Modelfile` / `template` / `system` / `params` edit to verify the four configurations remain in sync. Exits 0 if in sync, 1 with a per-key diff if not. |
|
| 100 |
|
| 101 |
+
GGUF-only release. Pull the Heretic safetensors from [`llmfan46/Qwen3.6-35B-A3B-uncensored-heretic`](https://huggingface.co/llmfan46/Qwen3.6-35B-A3B-uncensored-heretic) if you need the `transformers` tree (or the vanilla pre-Heretic base from [`Qwen/Qwen3.6-35B-A3B`](https://huggingface.co/Qwen/Qwen3.6-35B-A3B)).
|
| 102 |
+
|
| 103 |
+
> **Bundled blob status:** the `Janus-35B-A3B.Q4_K_M.gguf` shipped here is the
|
| 104 |
+
> legacy pre-Heretic Qwen 3.6 35B-A3B quant — it loads and behaves like vanilla
|
| 105 |
+
> Qwen 3.6 35B-A3B for now. A Heretic rebundle (from
|
| 106 |
+
> [`llmfan46/Qwen3.6-35B-A3B-uncensored-heretic-GGUF`](https://huggingface.co/llmfan46/Qwen3.6-35B-A3B-uncensored-heretic-GGUF))
|
| 107 |
+
> is pending; until then, pull a GGUF from that repo directly for the uncensored
|
| 108 |
+
> Heretic behavior.
|
| 109 |
|
| 110 |
## Architecture
|
| 111 |
|
|
|
|
| 326 |
- **Quantization-induced quality loss.** Q4_K_M is a strong general-purpose quant but does measurably degrade math and code accuracy compared to BF16. If you need maximum quality, run the upstream safetensors on a GPU that fits BF16 (~70 GB).
|
| 327 |
- **MoE expert utilization is uneven.** Stock Qwen3.6-35B-A3B routes 8 of 256 experts per token. On narrow domains (e.g. only one programming language) a small subset of experts dominates; load-balance loss was a training-time concern, not a runtime guarantee.
|
| 328 |
- **Thinking traces can loop.** Like most reasoning-distilled models, Janus-35B occasionally gets stuck repeating itself inside `<think>` tags. Mitigations: lower temperature to 0.4-0.6, raise `repeat_penalty` to 1.08, or set a `<think>`-token budget cap if your loader supports it.
|
| 329 |
+
- **Uncensored base — not aligned with any specific safety policy.** This is a personal repackage of an open-weight base whose refusal behavior has been abliterated away (the llmfan46 Heretic base). There is no RLHF refusal layer; the model will attempt most requests, so downstream safety is entirely the operator's responsibility.
|
| 330 |
- **No formal evaluation in this card.** Numbers in the hardware table are estimates, not measured. If you produce real benchmarks (MMLU, HumanEval, etc.) and want them included, file a PR.
|
| 331 |
|
| 332 |
## Related models
|
| 333 |
|
| 334 |
| Model | Size | Notes |
|
| 335 |
|---|---|---|
|
| 336 |
+
| [llmfan46/Qwen3.6-35B-A3B-uncensored-heretic](https://huggingface.co/llmfan46/Qwen3.6-35B-A3B-uncensored-heretic) | 35B / 3B active | **Immediate base.** Uncensored Heretic abliteration of Qwen 3.6 35B-A3B; `transformers`-native safetensors. |
|
| 337 |
+
| [llmfan46/Qwen3.6-35B-A3B-uncensored-heretic-GGUF](https://huggingface.co/llmfan46/Qwen3.6-35B-A3B-uncensored-heretic-GGUF) | 35B / 3B active | Heretic GGUFs — pull one here for the uncensored behavior until the bundled blob is rebundled. |
|
| 338 |
+
| [llmfan46/Qwen3.6-35B-A3B-uncensored-heretic-Native-MTP-Preserved](https://huggingface.co/llmfan46/Qwen3.6-35B-A3B-uncensored-heretic-Native-MTP-Preserved) | 35B / 3B active | Same Heretic base but keeps the MTP head for vLLM / SGLang speculative decoding. |
|
| 339 |
+
| [Qwen/Qwen3.6-35B-A3B](https://huggingface.co/Qwen/Qwen3.6-35B-A3B) | 35B / 3B active | Upstream pre-Heretic base model. `transformers`-native multimodal weights. |
|
| 340 |
+
| [FoolDev/Thanatos-27B](https://huggingface.co/FoolDev/Thanatos-27B) | 27B dense | Dense sibling on the [`llmfan46/Qwen3.6-27B-uncensored-heretic-v2`](https://huggingface.co/llmfan46/Qwen3.6-27B-uncensored-heretic-v2) Heretic base. Same teacher (Fable 5), same dataset family, smaller memory footprint, no MoE quirks. (The old `FoolDev/Thanatos-27B-Heretic` slug now serves a 307 to this path.) |
|
| 341 |
| [Crownelius/Crow-9B-HERETIC-4.6](https://huggingface.co/Crownelius/Crow-9B-HERETIC-4.6) | 9B dense | Heretic-flavored fine-tune of the same Qwen 3.5 9B base used as a smaller starting point. Useful as a fast first-pass model when 35B is too heavy for the host. |
|
| 342 |
|
| 343 |
## Credits
|
| 344 |
|
| 345 |
+
- Immediate base: [llmfan46/Qwen3.6-35B-A3B-uncensored-heretic](https://huggingface.co/llmfan46/Qwen3.6-35B-A3B-uncensored-heretic) — Heretic-style abliteration of Qwen 3.6 35B-A3B
|
| 346 |
+
- Upstream base: [Qwen/Qwen3.6-35B-A3B](https://huggingface.co/Qwen/Qwen3.6-35B-A3B) (Alibaba)
|
| 347 |
- Reasoning teacher: Claude Fable 5 (Anthropic)
|
| 348 |
- Distillation lineage and dataset curation: [Crownelius](https://huggingface.co/Crownelius)
|
| 349 |
|
|
|
|
|
|
|