lancejames221b commited on
Commit
874da54
Β·
verified Β·
1 Parent(s): 2c517d8

Add files using upload-large-folder tool

Browse files
Files changed (2) hide show
  1. README.md +92 -38
  2. razorstrike-v1-Q4_K_M.gguf +2 -2
README.md CHANGED
@@ -1,53 +1,107 @@
1
  ---
2
  license: apache-2.0
3
- base_model:
4
- - Qwen/Qwen3.5-35B-A3B-Base
5
- - deepreinforce-ai/Ornith-1.0-35B
6
  tags:
7
- - qwen3_5_moe
8
- - gguf
9
- - moe
10
- - reasoning
11
- - agentic
12
- - security
13
- - llama.cpp
14
- - ollama
 
 
 
 
 
15
  language:
16
- - en
17
  ---
18
 
19
- # RazorStrike-v1 (GGUF, Q4_K_M)
20
 
21
- Text-only GGUF quantization of [lancejames221b/razorstrike-v1](https://huggingface.co/lancejames221b/razorstrike-v1)
22
- (the MLX 4-bit multimodal original). Vision tower is not included in GGUF (text-only inference). An uncensored
23
- (abliterated) variant is also available: [razorstrike-v1-uncensored-GGUF](https://huggingface.co/lancejames221b/razorstrike-v1-uncensored-GGUF).
24
 
25
- A multi-donor task-arithmetic merge on the **Qwen3.5-35B-A3B** MoE base (hybrid linear-attention/SSM,
26
- 256 experts).
 
 
 
 
 
 
 
 
27
 
28
  ## Composition
29
- - **Base:** `ornith-agents1` = Ornith-1.0-35B (reasoning) + Agents-A1 (agentic-coding; router taken verbatim
30
- from Agents-A1)
31
- - **+ Opus-Reasoning** distilled donor @ weight 0.30 (task-arithmetic)
32
- - **+ AgentWorld** terminal/OS grounding @ weight 0.10 (task-arithmetic)
33
-
34
- ## Requires
35
- This model uses the `qwen35moe` GGUF architecture (`Qwen3_5MoeForConditionalGeneration`). Requires a
36
- **recent llama.cpp / Ollama build with Qwen3.5 MoE support**. `Q4_K_M`, 20.2G, 733 tensors.
37
-
38
- ## Recommended settings
39
- `temp 0.6, top_p 0.95, top_k 20, repeat_penalty 1.1`. Give a generous `max_tokens`/`num_predict` (β‰₯2000) β€”
40
- reasoning donors mean the model thinks before answering; a small budget can yield empty output. Use a
41
- "think fast, not long" system prompt to keep responses tight.
42
-
43
- ## Ollama
44
- Verified working β€” pull directly from this HF repo (no separate registry publish needed):
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
45
  ```
 
 
 
46
  ollama pull hf.co/lancejames221b/razorstrike-v1-GGUF
47
- ollama run hf.co/lancejames221b/razorstrike-v1-GGUF
48
  ```
49
- Tested end-to-end (pull + load + generate) on the `qwen35moe` architecture.
 
 
 
50
 
51
  ## License
52
- `apache-2.0` (umbrella). Ornith component is MIT; Opus donor distilled from Claude-4.7-Opus (confirm upstream
53
- usage terms for your use case).
 
1
  ---
2
  license: apache-2.0
3
+ base_model: Qwen/Qwen3.6-35B-A3B
 
 
4
  tags:
5
+ - gguf
6
+ - qwen3_5_moe
7
+ - moe
8
+ - merge
9
+ - dare-ties
10
+ - reasoning
11
+ - agentic
12
+ - coding
13
+ - security
14
+ - uncensored
15
+ - abliterated
16
+ - llama.cpp
17
+ - ollama
18
  language:
19
+ - en
20
  ---
21
 
22
+ # RazorStrike-v1 (GGUF)
23
 
24
+ RazorStrike-v1 is a multi-donor **DARE-TIES** task-arithmetic merge built on the **Qwen3.6-35B-A3B** MoE base (hybrid linear-attention/SSM architecture, 256 experts, 262144 token context). It fuses a reasoning + uncensoring donor with an agentic/coding donor on top of the Qwen3.6 anchor.
 
 
25
 
26
+ This repo hosts the **GGUF Q4_K_M quantized** build (~19.7GB), for `llama.cpp` / Ollama. Text-only (vision tower and MTP head are not included in this GGUF).
27
+
28
+ ## Approach
29
+
30
+ RazorStrike-v1's build process is empirical, not assumption-driven: every merge decision is validated against real generated output rather than trusted on theory alone.
31
+
32
+ 1. **Task-arithmetic delta merging (DARE-TIES)** β€” donors contribute as deltas against a shared anchor (`donor - anchor`), not as raw weight averages.
33
+ 2. **Coherence-gate before and after every stage** β€” a dedicated battery of coherence and refusal-behavior prompts is run on every candidate build, at both greedy (temp 0.0) and sampled (temp 0.6) decoding.
34
+ 3. **Root-cause, not workaround, on defects** β€” a coding-context language-contamination defect found during development was traced with a systematic bisect (raw single-donor tests, then pairwise donor-combination tests), correctly identifying a specific donor's task vector as the cause (see below) instead of shipping a band-aid fix.
35
+ 4. **Cross-runtime re-verification** β€” this GGUF build was smoke-tested through `llama-server`'s actual C++ inference kernels (not just conversion success) on both a plain completion and the specific chat prompt that originally triggered the contamination defect, confirming the fix holds across runtimes (MLX and llama.cpp), not just the runtime it was originally verified on.
36
 
37
  ## Composition
38
+
39
+ RazorStrike-v1 is a **DARE-TIES** (drop-and-rescale + sign-election disjoint merge) of two donor models applied on top of a Qwen3.6-35B-A3B anchor:
40
+
41
+ | Role | Model | Weight | DARE density | Contribution |
42
+ |---|---|---|---|---|
43
+ | Anchor | `Qwen/Qwen3.6-35B-A3B` | β€” | β€” | Base for all non-merged tensors: embeddings, `lm_head`, norms, SSM dynamics, MTP head |
44
+ | Donor 1 (dominant) | huihui-ai's Claude-4.7-Opus-abliterated build (Qwen3.6-35B-A3B lineage) | 0.45 | 0.55 | Reasoning (via an embedded Opus-Reasoning-Distilled lineage) **and** uncensoring (weights-only abliteration / refusal removal). Router (`mlp.gate`, 41 tensors) is taken **verbatim** from this donor. |
45
+ | Donor 2 | `AlexWortega/SIQ-1-35B` | 0.40 | 0.50 | Agentic tool-use, coding, and autoresearch capability |
46
+
47
+ DARE-TIES is applied **only** to mergeable tensors (attention Q/K/V/O, linear-attention in/out projections, routed-expert gate_up/down, shared-expert FFN + gate). The router, norms, embeddings, `lm_head`, and SSM dynamics are all verbatim-copied from the anchor.
48
+
49
+ Because the dominant donor is already an abliterated (refusal-removed) build, RazorStrike-v1 is **uncensored by construction**.
50
+
51
+ ## What was tried and dropped
52
+
53
+ A third donor, `UnipatAI/UniMath-35B-A3B`, was originally evaluated to add dedicated math/proof-synthesis specialization. It was **excluded** after root-cause investigation via pairwise donor-combination testing found that UniMath deterministically caused **Chinese-character (CJK) contamination in coding-context generation** whenever merged with *any* other donor via DARE-TIES. This defect was confirmed absent in every donor tested individually β€” it was an emergent interaction of the merge itself, not a property of UniMath alone.
54
+
55
+ UniMath was dropped entirely. **This build has no dedicated math-specialist donor** β€” a known scope limitation, not an oversight.
56
+
57
+ ## Verification
58
+
59
+ - **16/16 coherence tests clean** (reasoning, math, terminal, coding Γ—3, agentic, prose β€” temp 0.0 and 0.6), **3/3 refusal-battery tests complied** (keylogger/malware, phishing, controlled-substance synthesis) β€” verified on the bf16 master and the MLX 4-bit build.
60
+ - **This GGUF re-verified separately**: plain completion smoke test (no chat template) came back coherent, and the specific chat-template prompt that originally triggered the CJK-contamination defect was re-tested through `llama-server` at temp=0.0 β€” clean, no contamination, matches the MLX-side result.
61
+
62
+ ### A note on uncensoring
63
+
64
+ This is an abliterated/uncensored build. It does not refuse security-research, offensive-security, or other sensitive-but-legitimate technical requests the way an aligned instruction-tuned model would. It is provided for research, red-teaming, and technical use. Responsibility for lawful and ethical use of this model rests entirely with the user.
65
+
66
+ ## Recommended inference settings
67
+
68
+ These match Qwen's own documented "Thinking mode, precise coding tasks" preset for the Qwen3.6-35B-A3B base:
69
+
70
+ ```
71
+ temperature: 0.6
72
+ top_p: 0.95
73
+ top_k: 20
74
+ min_p: 0.0
75
+ presence_penalty: 0.0
76
+ repetition_penalty: 1.0
77
+ ```
78
+
79
+ Because the dominant donor is reasoning-derived, RazorStrike-v1 can produce long internal reasoning traces if left unconstrained. Give it a generous context/`n_predict` budget, or use a "think fast, not long" system-prompt directive to keep responses tight.
80
+
81
+ ## Architecture
82
+
83
+ - **Type**: `qwen35moe` (llama.cpp arch name) / `Qwen3_5MoeForConditionalGeneration` (HF) β€” hybrid linear-attention + SSM Mixture-of-Experts, 256 experts
84
+ - **Context**: 262,144 tokens (inherited from the Qwen3.6-35B-A3B anchor)
85
+ - **Quantization**: Q4_K_M (~4.88 bits/weight effective), 19.7GB
86
+
87
+ ## Usage
88
+
89
+ **llama.cpp:**
90
+ ```bash
91
+ llama-server -hf lancejames221b/razorstrike-v1-GGUF --port 8080
92
+ # or, if downloaded locally:
93
+ llama-server -m razorstrike-v1-Q4_K_M.gguf --port 8080 -c 32768
94
  ```
95
+
96
+ **Ollama:**
97
+ ```bash
98
  ollama pull hf.co/lancejames221b/razorstrike-v1-GGUF
 
99
  ```
100
+
101
+ ## Roadmap
102
+
103
+ Future versions are intended to layer domain-specific **LoRA SFT specialists** on top of this merged base rather than folding more donors into the task-arithmetic merge itself β€” planned specialist domains include **reverse engineering (RE)** and **cryptography**.
104
 
105
  ## License
106
+
107
+ Released under **Apache 2.0**, matching the Qwen3.6-35B-A3B base model. This is a derivative merge, so users should also review the license terms of the constituent donor models β€” huihui-ai's Claude-4.7-Opus-abliterated build and `AlexWortega/SIQ-1-35B` β€” before use.
razorstrike-v1-Q4_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:859d34fcb21637edce2b05b1c99679b91387af9abdbcd611c04e2ab36371849a
3
- size 21166757632
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d3a86f2d016243f501f5156b1136f7ce54031613819e0031d38bc6a987648876
3
+ size 21166757888