FoolDev Claude Fable 5 commited on
Commit
f6b93b0
Β·
1 Parent(s): 39c0d86

Post-audit README fixes + add .gitignore

Browse files

A read-only 5-dimension audit of the model card surfaced two verified
doc-accuracy defects and one repo-hygiene gap vs the dense sibling.

Fixed (README):
- Hardware section said "18.9 GB" for the bundled Q4_K_M; the file is
~19.8 GB and the rest of the card says "~19 GB" (TL;DR, "What's here"
table, Ollama quick-start). Unified to "~19 GB".
- "Related models" table still told users to pull Heretic GGUFs "until
the bundled blob is rebundled" β€” but the rebundle is done (commit
b302576; see the "Bundled blob status" callout). Reworded to "pull
other quants here; the bundled Q4_K_M is already this Heretic quant."

Added:
- .gitignore, mirrored from FoolDev/Thanatos-27B-HERETIC and tailored to
Janus (keeps the shipped Janus-35B-A3B.*.gguf; drops the sibling's
rename_arch.py rebadge line, which Janus has no script for). The repo
ships Python scripts that generate __pycache__ and had no ignore file
guarding the public repo against junk / stray-GGUF commits.

CHANGELOG [Unreleased] updated to match. Bridge-sync still passes; the
bundled GGUF is not caught by the new ignore rules.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>

Files changed (3) hide show
  1. .gitignore +29 -0
  2. CHANGELOG.md +19 -0
  3. README.md +2 -2
.gitignore ADDED
@@ -0,0 +1,29 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # Python
2
+ __pycache__/
3
+ *.py[cod]
4
+ *.egg-info/
5
+ .venv/
6
+ venv/
7
+
8
+ # Local model weights. We don't redistribute the upstream Qwen GGUFs
9
+ # here β€” scripts/build.sh fetches one from
10
+ # llmfan46/Qwen3.6-35B-A3B-uncensored-heretic-GGUF locally. The single
11
+ # Janus-35B-A3B.*.gguf we DO ship backs the HF/Ollama "Use this model"
12
+ # widget (ollama run hf.co/FoolDev/Janus-35B-HERETIC).
13
+ *.gguf
14
+ !Janus-35B-A3B.*.gguf
15
+ *.safetensors
16
+ *.bin
17
+
18
+ # Build / runtime artifacts that get created if anyone runs hf download or
19
+ # scripts/build.sh from inside the repo.
20
+ .cache/
21
+ *.incomplete
22
+ *.lock
23
+
24
+ # Editor / OS
25
+ .DS_Store
26
+ .idea/
27
+ .vscode/
28
+ *.swp
29
+ *~
CHANGELOG.md CHANGED
@@ -8,6 +8,25 @@ track the **tooling and documentation**, not the underlying base model.
8
 
9
  ## [Unreleased]
10
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
11
  ### Changed (HF repo rename β†’ FoolDev/Janus-35B-HERETIC)
12
  - **HF repository slug renamed `FoolDev/Janus-35B` β†’ `FoolDev/Janus-35B-HERETIC`.**
13
  The old slug now 307-redirects to the new one. The model's **display name
 
8
 
9
  ## [Unreleased]
10
 
11
+ ### Fixed (post-rebundle README drift)
12
+ - **Hardware section GGUF size `18.9 GB` β†’ `~19 GB`** β€” matches the actual
13
+ ~19.8 GB bundled file and the `~19 GB` already used in the TL;DR, the
14
+ "What's here" table, and the Ollama quick-start.
15
+ - **Dropped the stale "until the bundled blob is rebundled" note** from the
16
+ Heretic-GGUF row of the "Related models" table. The rebundle is complete
17
+ (see the base-swap entry below and the "Bundled blob status" callout); the
18
+ row now reads "pull other quants here; the bundled Q4_K_M is already this
19
+ Heretic quant."
20
+
21
+ ### Added (repo hygiene)
22
+ - **`.gitignore`** β€” mirrors the dense sibling `FoolDev/Thanatos-27B-HERETIC`,
23
+ tailored to Janus: ignores Python caches / venvs, HF / `scripts/build.sh`
24
+ runtime artifacts (`.cache/`, `*.incomplete`, `*.lock`), and stray weights
25
+ (`*.gguf` / `*.safetensors` / `*.bin`) while keeping the shipped
26
+ `Janus-35B-A3B.*.gguf` that backs the "Use this model" widget. Omits the
27
+ sibling's `scripts/rename_arch.py` rebadge-ignore line (Janus has no such
28
+ script).
29
+
30
  ### Changed (HF repo rename β†’ FoolDev/Janus-35B-HERETIC)
31
  - **HF repository slug renamed `FoolDev/Janus-35B` β†’ `FoolDev/Janus-35B-HERETIC`.**
32
  The old slug now 307-redirects to the new one. The model's **display name
README.md CHANGED
@@ -220,7 +220,7 @@ Behavior rules:
220
 
221
  ## Hardware requirements
222
 
223
- This is an 18.9 GB Q4_K_M GGUF. Ollama's runtime footprint at default settings is **roughly 2Γ— the model file** (weights mmap + compute graph allocation), plus KV cache β€” so ~38 GB total memory at `num_ctx 16384`. The compute-graph allocation scales with context and batch size, so 32 GB hosts can fit the model by trimming both (see Z13 row in the table).
224
 
225
  | Hardware | Status |
226
  |---|---|
@@ -336,7 +336,7 @@ print(resp.choices[0].message.tool_calls)
336
  | Model | Size | Notes |
337
  |---|---|---|
338
  | [llmfan46/Qwen3.6-35B-A3B-uncensored-heretic](https://huggingface.co/llmfan46/Qwen3.6-35B-A3B-uncensored-heretic) | 35B / 3B active | **Immediate base.** Uncensored Heretic abliteration of Qwen 3.6 35B-A3B; `transformers`-native safetensors. |
339
- | [llmfan46/Qwen3.6-35B-A3B-uncensored-heretic-GGUF](https://huggingface.co/llmfan46/Qwen3.6-35B-A3B-uncensored-heretic-GGUF) | 35B / 3B active | Heretic GGUFs β€” pull one here for the uncensored behavior until the bundled blob is rebundled. |
340
  | [llmfan46/Qwen3.6-35B-A3B-uncensored-heretic-Native-MTP-Preserved](https://huggingface.co/llmfan46/Qwen3.6-35B-A3B-uncensored-heretic-Native-MTP-Preserved) | 35B / 3B active | Same Heretic base but keeps the MTP head for vLLM / SGLang speculative decoding. |
341
  | [Qwen/Qwen3.6-35B-A3B](https://huggingface.co/Qwen/Qwen3.6-35B-A3B) | 35B / 3B active | Upstream pre-Heretic base model. `transformers`-native multimodal weights. |
342
  | [FoolDev/Thanatos-27B-HERETIC](https://huggingface.co/FoolDev/Thanatos-27B-HERETIC) | 27B dense | Dense sibling on the [`llmfan46/Qwen3.6-27B-uncensored-heretic-v2`](https://huggingface.co/llmfan46/Qwen3.6-27B-uncensored-heretic-v2) Heretic base. Same teacher (Fable 5), same dataset family, smaller memory footprint, no MoE quirks. (The older `FoolDev/Thanatos-27B` and `Thanatos-27B-Heretic` slugs now 307 to this path.) |
 
220
 
221
  ## Hardware requirements
222
 
223
+ This is a ~19 GB Q4_K_M GGUF. Ollama's runtime footprint at default settings is **roughly 2Γ— the model file** (weights mmap + compute graph allocation), plus KV cache β€” so ~38 GB total memory at `num_ctx 16384`. The compute-graph allocation scales with context and batch size, so 32 GB hosts can fit the model by trimming both (see Z13 row in the table).
224
 
225
  | Hardware | Status |
226
  |---|---|
 
336
  | Model | Size | Notes |
337
  |---|---|---|
338
  | [llmfan46/Qwen3.6-35B-A3B-uncensored-heretic](https://huggingface.co/llmfan46/Qwen3.6-35B-A3B-uncensored-heretic) | 35B / 3B active | **Immediate base.** Uncensored Heretic abliteration of Qwen 3.6 35B-A3B; `transformers`-native safetensors. |
339
+ | [llmfan46/Qwen3.6-35B-A3B-uncensored-heretic-GGUF](https://huggingface.co/llmfan46/Qwen3.6-35B-A3B-uncensored-heretic-GGUF) | 35B / 3B active | Heretic GGUFs β€” pull other quants here; the bundled Q4_K_M is already this Heretic quant. |
340
  | [llmfan46/Qwen3.6-35B-A3B-uncensored-heretic-Native-MTP-Preserved](https://huggingface.co/llmfan46/Qwen3.6-35B-A3B-uncensored-heretic-Native-MTP-Preserved) | 35B / 3B active | Same Heretic base but keeps the MTP head for vLLM / SGLang speculative decoding. |
341
  | [Qwen/Qwen3.6-35B-A3B](https://huggingface.co/Qwen/Qwen3.6-35B-A3B) | 35B / 3B active | Upstream pre-Heretic base model. `transformers`-native multimodal weights. |
342
  | [FoolDev/Thanatos-27B-HERETIC](https://huggingface.co/FoolDev/Thanatos-27B-HERETIC) | 27B dense | Dense sibling on the [`llmfan46/Qwen3.6-27B-uncensored-heretic-v2`](https://huggingface.co/llmfan46/Qwen3.6-27B-uncensored-heretic-v2) Heretic base. Same teacher (Fable 5), same dataset family, smaller memory footprint, no MoE quirks. (The older `FoolDev/Thanatos-27B` and `Thanatos-27B-Heretic` slugs now 307 to this path.) |