Upload folder using huggingface_hub
Browse files- README.RU.md +0 -1
- README.md +3 -11
README.RU.md
CHANGED
|
@@ -13,7 +13,6 @@ tags:
|
|
| 13 |
- quantized
|
| 14 |
- auto-round
|
| 15 |
- w4a16
|
| 16 |
-
- uncensored
|
| 17 |
- heretic
|
| 18 |
- mtp
|
| 19 |
- 256k-context
|
|
|
|
| 13 |
- quantized
|
| 14 |
- auto-round
|
| 15 |
- w4a16
|
|
|
|
| 16 |
- heretic
|
| 17 |
- mtp
|
| 18 |
- 256k-context
|
README.md
CHANGED
|
@@ -13,19 +13,10 @@ tags:
|
|
| 13 |
- quantized
|
| 14 |
- auto-round
|
| 15 |
- w4a16
|
| 16 |
-
- uncensored
|
| 17 |
- heretic
|
| 18 |
- mtp
|
| 19 |
- 256k-context
|
| 20 |
pipeline_tag: image-text-to-text
|
| 21 |
-
datasets:
|
| 22 |
-
- armand0e/claude-fable-5-claude-code
|
| 23 |
-
- greghavens/fable-5-coding-and-debugging-traces
|
| 24 |
-
- >-
|
| 25 |
-
CodeFlame/Qwen3.8-GLM5.2-Kimi-K3-GPT5.6-Gemini-3.1-Claude-Fable5-Mythos5-distillation
|
| 26 |
-
- Crownelius/Complete-FABLE.5-traces-2M
|
| 27 |
-
base_model:
|
| 28 |
-
- Qwen/Qwen3.8-27B
|
| 29 |
---
|
| 30 |
|
| 31 |
# goldhub/Qwen3.8-27B-INT4-W4A16-AutoRound
|
|
@@ -41,7 +32,7 @@ Aligned for unrestricted, "Heretic" level reasoning, this model bypasses standar
|
|
| 41 |
- **W4A16 AutoRound Quantization**: 4-bit weights, 16-bit activations. Group size 32, symmetric quantization, 1000 iterations for optimal calibration.
|
| 42 |
- **Smart Layer Preservation**: Critical layers (Vision encoders, `linear_attn` projections, and embeddings) are explicitly kept in FP16/BF16 to prevent multimodal degradation and attention collapse.
|
| 43 |
- **MTP Ready**: Full support for Multi-Token Prediction for blazing-fast inference speeds.
|
| 44 |
-
- **Uncensored / Heretic Alignment**: Excels in deep reasoning, creative writing, and unfiltered philosophical exploration without preachy refusals.
|
| 45 |
|
| 46 |
## 📊 Benchmark & Evaluation Highlights
|
| 47 |
|
|
@@ -204,4 +195,5 @@ python qwen_quantization.py \
|
|
| 204 |
|
| 205 |
---
|
| 206 |
|
| 207 |
-
**Made with 🔥 by Goldhub. Use responsibly. Think deeply.**
|
|
|
|
|
|
| 13 |
- quantized
|
| 14 |
- auto-round
|
| 15 |
- w4a16
|
|
|
|
| 16 |
- heretic
|
| 17 |
- mtp
|
| 18 |
- 256k-context
|
| 19 |
pipeline_tag: image-text-to-text
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 20 |
---
|
| 21 |
|
| 22 |
# goldhub/Qwen3.8-27B-INT4-W4A16-AutoRound
|
|
|
|
| 32 |
- **W4A16 AutoRound Quantization**: 4-bit weights, 16-bit activations. Group size 32, symmetric quantization, 1000 iterations for optimal calibration.
|
| 33 |
- **Smart Layer Preservation**: Critical layers (Vision encoders, `linear_attn` projections, and embeddings) are explicitly kept in FP16/BF16 to prevent multimodal degradation and attention collapse.
|
| 34 |
- **MTP Ready**: Full support for Multi-Token Prediction for blazing-fast inference speeds.
|
| 35 |
+
- **Semi-Uncensored / Heretic Alignment**: Excels in deep reasoning, creative writing, and unfiltered philosophical exploration without preachy refusals.
|
| 36 |
|
| 37 |
## 📊 Benchmark & Evaluation Highlights
|
| 38 |
|
|
|
|
| 195 |
|
| 196 |
---
|
| 197 |
|
| 198 |
+
**Made with 🔥 by Goldhub. Use responsibly. Think deeply.**
|
| 199 |
+
|