---
library_name: transformers
license: apache-2.0
language:
- en
pipeline_tag: text-generation
tags:
- SmolLM2
- 1.7B
- Instruct
- Heretic
- Abliterated
- Uncensored
- GGUF
base_model:
- HuggingFaceTB/SmolLM2-1.7B
---
## SmolLM2-1.7B-Instruct-Heretic-GGUF

A decensored version of [HuggingFaceTB/SmolLM2-1.7B-Instruct](https://huggingface.co/HuggingFaceTB/SmolLM2-1.7B-Instruct), made using [Heretic](https://github.com/p-e-w/heretic) v1.1.0

Safetensors version available here: [ChiKoi7/SmolLM2-1.7B-Instruct-Heretic](https://huggingface.co/ChiKoi7/SmolLM2-1.7B-Instruct-Heretic)

|     | SmolLM2-1.7B-Instruct-Heretic <br> | Original model <br> [SmolLM2-1.7B-Instruct](https://huggingface.co/HuggingFaceTB/SmolLM2-1.7B-Instruct) |
| --- | --- | --- |
| **Refusals** | 5/100 | 37/100 |
| **KL divergence** | 0.0523 | 0 *(by definition)* |

## Heretic Abliteration Parameters

| Parameter | Value |
| :-------- | :---: |
| **direction_index** | 18.34 |
| **attn.o_proj.max_weight** | 0.81 |
| **attn.o_proj.max_weight_position** | 14.52 |
| **attn.o_proj.min_weight** | 0.56 |
| **attn.o_proj.min_weight_distance** | 8.50 |
| **mlp.down_proj.max_weight** | 1.14 |
| **mlp.down_proj.max_weight_position** | 17.18 |
| **mlp.down_proj.min_weight** | 0.93 |
| **mlp.down_proj.min_weight_distance** | 7.16 |