FoolDev Claude Fable 5 commited on
Commit
ab017c1
·
1 Parent(s): 87a254d

docs: fix model-tag seam for HF-pull users + vision caveat + CITATION version

Browse files

From the round-2 review:
- The `ollama show janus` note claimed "either path," but the short `janus` tag
only exists after the local build (path B); every inference example hard-codes
model "janus", so a TL;DR/path-A puller hit `model 'janus' not found` on their
first snippet. Corrected the claim and added a note to substitute the full
hf.co/FoolDev/Janus-35B-HERETIC tag (or `ollama cp`).
- llama-server vision block now documents the reasoning_content/content split
and the >=500 max_tokens budget (parity with the Thanatos sibling).
- CITATION.cff gains version 0.1.0 + date-released 2026-05-20 so the HF "Cite
this model" widget generates a dated, versioned citation.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>

Files changed (3) hide show
  1. CHANGELOG.md +12 -0
  2. CITATION.cff +2 -0
  3. README.md +6 -1
CHANGELOG.md CHANGED
@@ -18,6 +18,9 @@ track the **tooling and documentation**, not the underlying base model.
18
  - **Frontmatter tags `reasoning` + `distillation`.** The card positions Janus
19
  as reasoning-first and distilled (and `CITATION.cff` already lists both as
20
  keywords), but neither was a searchable Hub tag — added both.
 
 
 
21
 
22
  ### Changed (default sampling matched to the Fable teacher)
23
  - **Default sampling raised to a Fable-matched profile** in `params` and the
@@ -29,6 +32,15 @@ track the **tooling and documentation**, not the underlying base model.
29
  override.
30
 
31
  ### Fixed
 
 
 
 
 
 
 
 
 
32
  - **Hardware-table eval disclaimer no longer self-contradicts.** "Known
33
  limitations" said the table numbers are "estimates, not measured," yet the
34
  Z13 row records a measured 28.71 tok/s — reworded to carve out that row.
 
18
  - **Frontmatter tags `reasoning` + `distillation`.** The card positions Janus
19
  as reasoning-first and distilled (and `CITATION.cff` already lists both as
20
  keywords), but neither was a searchable Hub tag — added both.
21
+ - **`CITATION.cff` now carries `version` + `date-released`.** Added `0.1.0` /
22
+ `2026-05-20` (mirroring the CHANGELOG release anchor) so the HF "Cite this
23
+ model" widget generates a dated, versioned citation.
24
 
25
  ### Changed (default sampling matched to the Fable teacher)
26
  - **Default sampling raised to a Fable-matched profile** in `params` and the
 
32
  override.
33
 
34
  ### Fixed
35
+ - **Inference examples no longer 404 for HF-pull users.** The `ollama show janus`
36
+ claim said "either path," but the short `janus` tag only exists after the local
37
+ build (path B); every inference example hard-codes `model: "janus"`, so a
38
+ TL;DR/path-A puller hit `model 'janus' not found`. Corrected the claim and added
39
+ a note to substitute the full `hf.co/FoolDev/Janus-35B-HERETIC` tag (or `ollama cp`).
40
+ - **Vision block documents the `reasoning_content` split.** The llama-server
41
+ vision recipe now notes the thinking trace lands in `message.reasoning_content`
42
+ and the answer in `message.content`, and to budget ≥500 `max_tokens` so
43
+ reasoning doesn't crowd out the answer (parity with the Thanatos sibling).
44
  - **Hardware-table eval disclaimer no longer self-contradicts.** "Known
45
  limitations" said the table numbers are "estimates, not measured," yet the
46
  Z13 row records a measured 28.71 tok/s — reworded to carve out that row.
CITATION.cff CHANGED
@@ -1,4 +1,6 @@
1
  cff-version: 1.2.0
 
 
2
  title: "Janus-35B: A Mixture-of-Experts Distillation Wrapper for llmfan46's Qwen 3.6 35B-A3B Uncensored Heretic"
3
  message: "If you use this model card or its accompanying files, please cite as below."
4
  type: software
 
1
  cff-version: 1.2.0
2
+ version: 0.1.0
3
+ date-released: "2026-05-20"
4
  title: "Janus-35B: A Mixture-of-Experts Distillation Wrapper for llmfan46's Qwen 3.6 35B-A3B Uncensored Heretic"
5
  message: "If you use this model card or its accompanying files, please cite as below."
6
  type: software
README.md CHANGED
@@ -149,12 +149,14 @@ ollama run hf.co/FoolDev/Janus-35B-HERETIC:Q4_K_M # same blob, explicit t
149
  ollama create janus -f Modelfile && ollama run janus
150
  ```
151
 
152
- After either path, `ollama show janus` should list `completion`, `tools`, and `thinking` under Capabilities.
153
 
154
  ### Inference examples
155
 
156
  Once the model is loaded (via `ollama run janus`, `lms server`, or `llama-server`), all the standard OpenAI-compatible clients work. Examples assume the loader is listening on `http://localhost:11434` (Ollama default) — adjust the port for LM Studio (`:1234`) or llama.cpp (`:8080`). Runnable versions of everything below live in [`examples/`](examples/README.md).
157
 
 
 
158
  #### curl
159
 
160
  ```bash
@@ -266,6 +268,9 @@ llama-server \
266
  --host 127.0.0.1 --port 8765 -c 8192 -ngl 99
267
  # then POST OpenAI-style chat completions with an image_url content block —
268
  # e.g. {"type":"image_url","image_url":{"url":"data:image/jpeg;base64,..."}}
 
 
 
269
 
270
  # B. CLI via llama-mtmd-cli (one-shot). It's a separate cmake target, so a
271
  # selective build can skip it; a plain `cmake --build build` produces it.
 
149
  ollama create janus -f Modelfile && ollama run janus
150
  ```
151
 
152
+ After the local build (path B), `ollama show janus` lists `completion`, `tools`, and `thinking` under Capabilities. (The HF-pull paths register the model under the full tag `hf.co/FoolDev/Janus-35B-HERETIC`, not `janus`.)
153
 
154
  ### Inference examples
155
 
156
  Once the model is loaded (via `ollama run janus`, `lms server`, or `llama-server`), all the standard OpenAI-compatible clients work. Examples assume the loader is listening on `http://localhost:11434` (Ollama default) — adjust the port for LM Studio (`:1234`) or llama.cpp (`:8080`). Runnable versions of everything below live in [`examples/`](examples/README.md).
157
 
158
+ > The examples use `model: "janus"`, the tag from the local build (path B). If you pulled via the TL;DR one-liner instead, use the full tag `hf.co/FoolDev/Janus-35B-HERETIC`, or run `ollama cp hf.co/FoolDev/Janus-35B-HERETIC janus` once to create the short tag.
159
+
160
  #### curl
161
 
162
  ```bash
 
268
  --host 127.0.0.1 --port 8765 -c 8192 -ngl 99
269
  # then POST OpenAI-style chat completions with an image_url content block —
270
  # e.g. {"type":"image_url","image_url":{"url":"data:image/jpeg;base64,..."}}
271
+ # The thinking trace arrives in message.reasoning_content; the visible
272
+ # answer is in message.content. Budget ≥500 max_tokens so the reasoning
273
+ # block doesn't crowd out the final answer.
274
 
275
  # B. CLI via llama-mtmd-cli (one-shot). It's a separate cmake target, so a
276
  # selective build can skip it; a plain `cmake --build build` produces it.