abrasdaosfjnps HauhauCS commited on
Commit
34ba6cd
Β·
0 Parent(s):

Duplicate from HauhauCS/Qwen3.6-27B-Uncensored-HauhauCS-Aggressive

Browse files

Co-authored-by: HauHau <HauhauCS@users.noreply.huggingface.co>

.gitattributes ADDED
@@ -0,0 +1,46 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ *.7z filter=lfs diff=lfs merge=lfs -text
2
+ *.arrow filter=lfs diff=lfs merge=lfs -text
3
+ *.bin filter=lfs diff=lfs merge=lfs -text
4
+ *.bz2 filter=lfs diff=lfs merge=lfs -text
5
+ *.ckpt filter=lfs diff=lfs merge=lfs -text
6
+ *.ftz filter=lfs diff=lfs merge=lfs -text
7
+ *.gz filter=lfs diff=lfs merge=lfs -text
8
+ *.h5 filter=lfs diff=lfs merge=lfs -text
9
+ *.joblib filter=lfs diff=lfs merge=lfs -text
10
+ *.lfs.* filter=lfs diff=lfs merge=lfs -text
11
+ *.mlmodel filter=lfs diff=lfs merge=lfs -text
12
+ *.model filter=lfs diff=lfs merge=lfs -text
13
+ *.msgpack filter=lfs diff=lfs merge=lfs -text
14
+ *.npy filter=lfs diff=lfs merge=lfs -text
15
+ *.npz filter=lfs diff=lfs merge=lfs -text
16
+ *.onnx filter=lfs diff=lfs merge=lfs -text
17
+ *.ot filter=lfs diff=lfs merge=lfs -text
18
+ *.parquet filter=lfs diff=lfs merge=lfs -text
19
+ *.pb filter=lfs diff=lfs merge=lfs -text
20
+ *.pickle filter=lfs diff=lfs merge=lfs -text
21
+ *.pkl filter=lfs diff=lfs merge=lfs -text
22
+ *.pt filter=lfs diff=lfs merge=lfs -text
23
+ *.pth filter=lfs diff=lfs merge=lfs -text
24
+ *.rar filter=lfs diff=lfs merge=lfs -text
25
+ *.safetensors filter=lfs diff=lfs merge=lfs -text
26
+ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
27
+ *.tar.* filter=lfs diff=lfs merge=lfs -text
28
+ *.tar filter=lfs diff=lfs merge=lfs -text
29
+ *.tflite filter=lfs diff=lfs merge=lfs -text
30
+ *.tgz filter=lfs diff=lfs merge=lfs -text
31
+ *.wasm filter=lfs diff=lfs merge=lfs -text
32
+ *.xz filter=lfs diff=lfs merge=lfs -text
33
+ *.zip filter=lfs diff=lfs merge=lfs -text
34
+ *.zst filter=lfs diff=lfs merge=lfs -text
35
+ *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ mmproj-Qwen3.6-27B-Uncensored-HauhauCS-Aggressive-f16.gguf filter=lfs diff=lfs merge=lfs -text
37
+ Qwen3.6-27B-Uncensored-HauhauCS-Aggressive-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
38
+ Qwen3.6-27B-Uncensored-HauhauCS-Aggressive-Q2_K_P.gguf filter=lfs diff=lfs merge=lfs -text
39
+ Qwen3.6-27B-Uncensored-HauhauCS-Aggressive-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
40
+ Qwen3.6-27B-Uncensored-HauhauCS-Aggressive-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
41
+ Qwen3.6-27B-Uncensored-HauhauCS-Aggressive-Q3_K_P.gguf filter=lfs diff=lfs merge=lfs -text
42
+ Qwen3.6-27B-Uncensored-HauhauCS-Aggressive-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
43
+ Qwen3.6-27B-Uncensored-HauhauCS-Aggressive-Q4_K_P.gguf filter=lfs diff=lfs merge=lfs -text
44
+ Qwen3.6-27B-Uncensored-HauhauCS-Aggressive-Q5_K_P.gguf filter=lfs diff=lfs merge=lfs -text
45
+ Qwen3.6-27B-Uncensored-HauhauCS-Aggressive-Q6_K_P.gguf filter=lfs diff=lfs merge=lfs -text
46
+ Qwen3.6-27B-Uncensored-HauhauCS-Aggressive-Q8_K_P.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3.6-27B-Uncensored-HauhauCS-Aggressive-IQ2_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:284ceed3b8a1acc1f9814c8a35f0110d6cbf923cd0592a8454fb7478c3392279
3
+ size 10004592096
Qwen3.6-27B-Uncensored-HauhauCS-Aggressive-IQ3_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:91164182148008f25b5451c3590e737cdc8d9ca887fb90e42824be9875f5fb67
3
+ size 12580873696
Qwen3.6-27B-Uncensored-HauhauCS-Aggressive-IQ3_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:96aac50cf1ac8e5baa09b65e4d9f9462a98b0a330f56f1723b87e0be44b257df
3
+ size 11967129056
Qwen3.6-27B-Uncensored-HauhauCS-Aggressive-IQ4_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8d9c7934b0f0481ed2ea9569a5724f9448162f6468303e0a6fa0e0192ad63ed0
3
+ size 15082505696
Qwen3.6-27B-Uncensored-HauhauCS-Aggressive-Q2_K_P.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f35137afb1d3da330346dcdc478513e405cfd1f571eebc71d31a038126cca3d9
3
+ size 11516069856
Qwen3.6-27B-Uncensored-HauhauCS-Aggressive-Q3_K_P.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d94c86ae1fda106e026bc3dc04305d7abb7285315b54f12d2d1d5ef59f3a3fc6
3
+ size 14301709536
Qwen3.6-27B-Uncensored-HauhauCS-Aggressive-Q4_K_P.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e44827d0ea3d5dd914f8c686ef530befaff6e9f0142f33956b4aa9e824f98a12
3
+ size 17536279776
Qwen3.6-27B-Uncensored-HauhauCS-Aggressive-Q5_K_P.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9b123d76df5b5af1328c65d963d1450c4279e9bd01d98d7091aa64c4f2cb38d5
3
+ size 20812953056
Qwen3.6-27B-Uncensored-HauhauCS-Aggressive-Q6_K_P.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f17b88ee70d2fb6f93c220ac306be0c8de631f20b3ffc82854162bb5e1b14192
3
+ size 23154960096
Qwen3.6-27B-Uncensored-HauhauCS-Aggressive-Q8_K_P.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:77672ff20cf3c6b99fe875df1e7f53fec4ded86e767fbfaef40b5def61b112ca
3
+ size 31963749856
README.md ADDED
@@ -0,0 +1,177 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ tags:
4
+ - uncensored
5
+ - qwen3.6
6
+ - gguf
7
+ - vision
8
+ - multimodal
9
+ language:
10
+ - en
11
+ - zh
12
+ - multilingual
13
+ pipeline_tag: image-text-to-text
14
+ base_model: Qwen/Qwen3.6-27B
15
+ ---
16
+
17
+ # Qwen3.6-27B-Uncensored-HauhauCS-Aggressive
18
+
19
+ > **[Join the Discord](https://discord.gg/SZ5vacTXYf)** for updates, roadmaps, projects, or just to chat.
20
+
21
+ Qwen3.6-27B uncensored by HauhauCS. **0/465 Refusals.** \*
22
+
23
+ > **Not sure which variant to pick?** 99.9%+ of users should use [**Balanced**](https://huggingface.co/HauhauCS/Qwen3.6-27B-Uncensored-HauhauCS-Balanced) β€” same 0/465 refusal rate, more stable sampling, great for agentic coding / tool-use / reasoning / creative writing. Pick **Aggressive** only if you specifically want the model to skip its preamble on hardcore prompts.
24
+
25
+ > **HuggingFace's "Hardware Compatibility" widget doesn't recognize K_P quants** β€” it may show fewer files than actually exist. Click **"View +X variants"** or go to **Files and versions** to see all available downloads.
26
+
27
+ ## About
28
+
29
+ No changes to datasets or capabilities. Fully functional, 100% of what the original authors intended β€” just without the refusals.
30
+
31
+ These are meant to be the best lossless uncensored models out there.
32
+
33
+ ## Aggressive vs Balanced
34
+
35
+ Both variants hit **0/465 refusals** on the benchmark. Same capability, same uncensoring outcome. The difference is *how* they deliver on edgy prompts:
36
+
37
+ | | Balanced (recommended default) | Aggressive (this release) |
38
+ |---|---|---|
39
+ | Refusal rate | 0/465 | 0/465 |
40
+ | On hardcore prompts | reasons out loud, occasional short disclaimer, then full answer | delivers the raw answer directly, no preamble |
41
+ | Best for | agentic coding, tool-use, reasoning, creative writing/RP | users who specifically want the model to skip the "talk itself into it" step |
42
+
43
+ If you don't have a strong reason to pick Aggressive, go [Balanced](https://huggingface.co/HauhauCS/Qwen3.6-27B-Uncensored-HauhauCS-Balanced) β€” it's the better default.
44
+
45
+ ## Downloads
46
+
47
+ | File | Quant | BPW | Size |
48
+ |------|-------|-----|------|
49
+ | [Qwen3.6-27B-Uncensored-HauhauCS-Aggressive-Q8_K_P.gguf](https://huggingface.co/HauhauCS/Qwen3.6-27B-Uncensored-HauhauCS-Aggressive/resolve/main/Qwen3.6-27B-Uncensored-HauhauCS-Aggressive-Q8_K_P.gguf) | Q8_K_P | 10.06 | 32 GB |
50
+ | β€” | Q8_0 | 8.5 | β€” |
51
+ | [Qwen3.6-27B-Uncensored-HauhauCS-Aggressive-Q6_K_P.gguf](https://huggingface.co/HauhauCS/Qwen3.6-27B-Uncensored-HauhauCS-Aggressive/resolve/main/Qwen3.6-27B-Uncensored-HauhauCS-Aggressive-Q6_K_P.gguf) | Q6_K_P | 7.07 | 23 GB |
52
+ | β€” | Q6_K | 6.6 | β€” |
53
+ | [Qwen3.6-27B-Uncensored-HauhauCS-Aggressive-Q5_K_P.gguf](https://huggingface.co/HauhauCS/Qwen3.6-27B-Uncensored-HauhauCS-Aggressive/resolve/main/Qwen3.6-27B-Uncensored-HauhauCS-Aggressive-Q5_K_P.gguf) | Q5_K_P | 6.47 | 21 GB |
54
+ | β€” | Q5_K_M | 5.7 | β€” |
55
+ | [Qwen3.6-27B-Uncensored-HauhauCS-Aggressive-Q4_K_P.gguf](https://huggingface.co/HauhauCS/Qwen3.6-27B-Uncensored-HauhauCS-Aggressive/resolve/main/Qwen3.6-27B-Uncensored-HauhauCS-Aggressive-Q4_K_P.gguf) | Q4_K_P | 5.4 | 18 GB |
56
+ | β€” | Q4_K_M | 4.88 | β€” |
57
+ | [Qwen3.6-27B-Uncensored-HauhauCS-Aggressive-IQ4_XS.gguf](https://huggingface.co/HauhauCS/Qwen3.6-27B-Uncensored-HauhauCS-Aggressive/resolve/main/Qwen3.6-27B-Uncensored-HauhauCS-Aggressive-IQ4_XS.gguf) | IQ4_XS | 4.32 | 15 GB |
58
+ | [Qwen3.6-27B-Uncensored-HauhauCS-Aggressive-Q3_K_P.gguf](https://huggingface.co/HauhauCS/Qwen3.6-27B-Uncensored-HauhauCS-Aggressive/resolve/main/Qwen3.6-27B-Uncensored-HauhauCS-Aggressive-Q3_K_P.gguf) | Q3_K_P | 4.39 | 14 GB |
59
+ | β€” | Q3_K_M | 3.9 | β€” |
60
+ | [Qwen3.6-27B-Uncensored-HauhauCS-Aggressive-IQ3_M.gguf](https://huggingface.co/HauhauCS/Qwen3.6-27B-Uncensored-HauhauCS-Aggressive/resolve/main/Qwen3.6-27B-Uncensored-HauhauCS-Aggressive-IQ3_M.gguf) | IQ3_M | 3.56 | 13 GB |
61
+ | [Qwen3.6-27B-Uncensored-HauhauCS-Aggressive-IQ3_XS.gguf](https://huggingface.co/HauhauCS/Qwen3.6-27B-Uncensored-HauhauCS-Aggressive/resolve/main/Qwen3.6-27B-Uncensored-HauhauCS-Aggressive-IQ3_XS.gguf) | IQ3_XS | 3.3 | 12 GB |
62
+ | [Qwen3.6-27B-Uncensored-HauhauCS-Aggressive-Q2_K_P.gguf](https://huggingface.co/HauhauCS/Qwen3.6-27B-Uncensored-HauhauCS-Aggressive/resolve/main/Qwen3.6-27B-Uncensored-HauhauCS-Aggressive-Q2_K_P.gguf) | Q2_K_P | 3.19 | 12 GB |
63
+ | [Qwen3.6-27B-Uncensored-HauhauCS-Aggressive-IQ2_M.gguf](https://huggingface.co/HauhauCS/Qwen3.6-27B-Uncensored-HauhauCS-Aggressive/resolve/main/Qwen3.6-27B-Uncensored-HauhauCS-Aggressive-IQ2_M.gguf) | IQ2_M | 2.69 | 10 GB |
64
+ | [mmproj-Qwen3.6-27B-Uncensored-HauhauCS-Aggressive-f16.gguf](https://huggingface.co/HauhauCS/Qwen3.6-27B-Uncensored-HauhauCS-Aggressive/resolve/main/mmproj-Qwen3.6-27B-Uncensored-HauhauCS-Aggressive-f16.gguf) | mmproj (f16) | β€” | 928 MB |
65
+
66
+ All quants generated with importance matrix (imatrix) for optimal quality preservation on abliterated weights.
67
+
68
+ ## What are K_P quants?
69
+
70
+ K_P ("Perfect") quants are HauhauCS custom quantizations that use model-specific analysis to selectively preserve quality where it matters most. Each model gets its own optimized quantization profile.
71
+
72
+ A K_P quant effectively bumps quality up by 1-2 quant levels at only ~5-15% larger file size than the base quant. Fully compatible with llama.cpp, LM Studio, and any GGUF-compatible runtime β€” no special builds needed.
73
+
74
+ **Note:** K_P quants may show as "?" in LM Studio's quant column. This is a display issue only β€” the model loads and runs fine.
75
+
76
+ ## Specs
77
+
78
+ - 27B dense parameters
79
+ - 64 layers, layout: `16 Γ— (3 Γ— (Gated DeltaNet β†’ FFN) β†’ 1 Γ— (Gated Attention β†’ FFN))`
80
+ - 48 linear attention layers + 16 full gated-attention layers
81
+ - Gated DeltaNet: 48 V heads / 16 QK heads, head dim 128
82
+ - Gated Attention: 24 Q heads / 4 KV heads, head dim 256, rope dim 64
83
+ - Hidden dim 5120, FFN dim 17408, vocab 248320
84
+ - 262K native context, extensible to ~1M with YaRN
85
+ - Natively multimodal (text, image, video) β€” ships with mmproj
86
+ - Based on [Qwen/Qwen3.6-27B](https://huggingface.co/Qwen/Qwen3.6-27B)
87
+
88
+ ## Recommended Settings
89
+
90
+ From the official Qwen authors:
91
+
92
+ **Thinking mode (default) β€” general tasks:**
93
+ - `temperature=1.0, top_p=0.95, top_k=20, min_p=0.0, presence_penalty=0.0, repetition_penalty=1.0`
94
+
95
+ **Thinking mode β€” precise coding / WebDev:**
96
+ - `temperature=0.6, top_p=0.95, top_k=20, min_p=0.0, presence_penalty=0.0, repetition_penalty=1.0`
97
+
98
+ **Non-thinking (Instruct) mode:**
99
+ - `temperature=0.7, top_p=0.80, top_k=20, min_p=0.0, presence_penalty=1.5, repetition_penalty=1.0`
100
+
101
+ **My personal preference:** I run `presence_penalty=1.5` even in thinking mode. Both values work, but with the official `0.0` it can think *a lot* more than it needs to. Bumping it to 1.5 reins that in without hurting output quality. Your call β€” try both.
102
+
103
+ **Important:**
104
+ - Keep at least 128K context to preserve thinking capabilities
105
+ - Recommended output length: 32,768 tokens for most queries, up to 81,920 for competition-tier math/code
106
+ - Use `--jinja` with llama.cpp for proper chat template handling
107
+ - Vision support requires the `mmproj` file alongside the main GGUF
108
+ - YaRN rope scaling is **static** in llama.cpp and can hurt short-context performance β€” only modify `rope_parameters` if you actually need >262K context
109
+
110
+ **Prompting tip:** this model is a bit more sensitive to prompt clarity than Qwen3.5-35B-A3B. Spell out format, constraints, and scope β€” it'll stay on rails much better than with vague instructions.
111
+
112
+ ## Turning Thinking On/Off
113
+
114
+ Qwen3.6 ships with thinking **on by default**. Turn it off when you want faster, shorter replies and don't need chain-of-thought.
115
+
116
+ > **Heads up:** Qwen3.6 **does not support** the `/think` and `/no_think` soft switches that Qwen3 had. You must use the chat-template kwarg below.
117
+
118
+ ### LM Studio
119
+
120
+ 1. Load the model
121
+ 2. Right-side settings panel β†’ **Model Settings** β†’ **Prompt Template** (or **Chat Template Options**)
122
+ 3. Set `enable_thinking` to `false` in the template kwargs
123
+ 4. Some LM Studio versions expose this as a direct **"Reasoning"** / **"Thinking"** toggle β€” same effect
124
+
125
+ ### llama.cpp
126
+
127
+ **llama-server β€” set as default for all requests:**
128
+ ```bash
129
+ llama-server -m Qwen3.6-27B-Uncensored-HauhauCS-Aggressive-Q4_K_P.gguf \
130
+ --mmproj mmproj-Qwen3.6-27B-Uncensored-HauhauCS-Aggressive-f16.gguf \
131
+ --jinja -c 131072 -ngl 99 \
132
+ --chat-template-kwargs '{"enable_thinking": false}'
133
+ ```
134
+
135
+ **Per-request via the OpenAI-compatible API:**
136
+ ```json
137
+ {
138
+ "model": "qwen3.6-27b",
139
+ "messages": [{"role": "user", "content": "..."}],
140
+ "chat_template_kwargs": {"enable_thinking": false}
141
+ }
142
+ ```
143
+
144
+ Python `openai` SDK:
145
+ ```python
146
+ client.chat.completions.create(
147
+ model="qwen3.6-27b",
148
+ messages=[{"role": "user", "content": "..."}],
149
+ extra_body={"chat_template_kwargs": {"enable_thinking": False}},
150
+ )
151
+ ```
152
+
153
+ **Agent scenarios β€” keep reasoning in context across turns:**
154
+ ```json
155
+ {"chat_template_kwargs": {"preserve_thinking": true}}
156
+ ```
157
+
158
+ This retains the reasoning block in chat history. Useful for agents where reasoning consistency across tool-call loops matters.
159
+
160
+ ## Usage
161
+
162
+ Works with llama.cpp, LM Studio, Jan, koboldcpp, and other GGUF-compatible runtimes.
163
+
164
+ ```bash
165
+ llama-cli -m Qwen3.6-27B-Uncensored-HauhauCS-Aggressive-Q4_K_P.gguf \
166
+ --mmproj mmproj-Qwen3.6-27B-Uncensored-HauhauCS-Aggressive-f16.gguf \
167
+ --jinja -c 131072 -ngl 99
168
+ ```
169
+
170
+ ## Other Models
171
+
172
+ - [Balanced variant](https://huggingface.co/HauhauCS/Qwen3.6-27B-Uncensored-HauhauCS-Balanced) (recommended default)
173
+ - [HauhauCS on HuggingFace](https://huggingface.co/HauhauCS/models)
174
+
175
+ ---
176
+
177
+ \* _Tested with both automated and manual refusal benchmarks β€” none found. If you hit one that's actually obstructive to your use case, [join the Discord](https://discord.gg/SZ5vacTXYf) and flag it so I can work on it in a future revision._
mmproj-Qwen3.6-27B-Uncensored-HauhauCS-Aggressive-f16.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:082ca68e4a53ce72ae934a11cdd54cf18d3dde6ac63c5d5a75a92bfacf7db430
3
+ size 927606976