goldhub commited on
Commit
272e031
·
verified ·
1 Parent(s): 75e2d74

Upload folder using huggingface_hub

Browse files
Files changed (2) hide show
  1. README.RU.md +0 -1
  2. README.md +3 -11
README.RU.md CHANGED
@@ -13,7 +13,6 @@ tags:
13
  - quantized
14
  - auto-round
15
  - w4a16
16
- - uncensored
17
  - heretic
18
  - mtp
19
  - 256k-context
 
13
  - quantized
14
  - auto-round
15
  - w4a16
 
16
  - heretic
17
  - mtp
18
  - 256k-context
README.md CHANGED
@@ -13,19 +13,10 @@ tags:
13
  - quantized
14
  - auto-round
15
  - w4a16
16
- - uncensored
17
  - heretic
18
  - mtp
19
  - 256k-context
20
  pipeline_tag: image-text-to-text
21
- datasets:
22
- - armand0e/claude-fable-5-claude-code
23
- - greghavens/fable-5-coding-and-debugging-traces
24
- - >-
25
- CodeFlame/Qwen3.8-GLM5.2-Kimi-K3-GPT5.6-Gemini-3.1-Claude-Fable5-Mythos5-distillation
26
- - Crownelius/Complete-FABLE.5-traces-2M
27
- base_model:
28
- - Qwen/Qwen3.8-27B
29
  ---
30
 
31
  # goldhub/Qwen3.8-27B-INT4-W4A16-AutoRound
@@ -41,7 +32,7 @@ Aligned for unrestricted, "Heretic" level reasoning, this model bypasses standar
41
  - **W4A16 AutoRound Quantization**: 4-bit weights, 16-bit activations. Group size 32, symmetric quantization, 1000 iterations for optimal calibration.
42
  - **Smart Layer Preservation**: Critical layers (Vision encoders, `linear_attn` projections, and embeddings) are explicitly kept in FP16/BF16 to prevent multimodal degradation and attention collapse.
43
  - **MTP Ready**: Full support for Multi-Token Prediction for blazing-fast inference speeds.
44
- - **Uncensored / Heretic Alignment**: Excels in deep reasoning, creative writing, and unfiltered philosophical exploration without preachy refusals.
45
 
46
  ## 📊 Benchmark & Evaluation Highlights
47
 
@@ -204,4 +195,5 @@ python qwen_quantization.py \
204
 
205
  ---
206
 
207
- **Made with 🔥 by Goldhub. Use responsibly. Think deeply.**
 
 
13
  - quantized
14
  - auto-round
15
  - w4a16
 
16
  - heretic
17
  - mtp
18
  - 256k-context
19
  pipeline_tag: image-text-to-text
 
 
 
 
 
 
 
 
20
  ---
21
 
22
  # goldhub/Qwen3.8-27B-INT4-W4A16-AutoRound
 
32
  - **W4A16 AutoRound Quantization**: 4-bit weights, 16-bit activations. Group size 32, symmetric quantization, 1000 iterations for optimal calibration.
33
  - **Smart Layer Preservation**: Critical layers (Vision encoders, `linear_attn` projections, and embeddings) are explicitly kept in FP16/BF16 to prevent multimodal degradation and attention collapse.
34
  - **MTP Ready**: Full support for Multi-Token Prediction for blazing-fast inference speeds.
35
+ - **Semi-Uncensored / Heretic Alignment**: Excels in deep reasoning, creative writing, and unfiltered philosophical exploration without preachy refusals.
36
 
37
  ## 📊 Benchmark & Evaluation Highlights
38
 
 
195
 
196
  ---
197
 
198
+ **Made with 🔥 by Goldhub. Use responsibly. Think deeply.**
199
+