---
tags:
- heretic
- uncensored
- decensored
- abliterated
language:
- en
base_model:
- dphn/Dolphin3.0-Mistral-24B
library_name: transformers
---
# This is a decensored version of [dphn/Dolphin3.0-Mistral-24B](https://huggingface.co/dphn/Dolphin3.0-Mistral-24B), made using [Heretic](https://github.com/p-e-w/heretic) v1.2.0

## Abliteration parameters

| Parameter | Value |
| :-------- | :---: |
| **direction_index** | 25.89 |
| **attn.o_proj.max_weight** | 1.48 |
| **attn.o_proj.max_weight_position** | 23.42 |
| **attn.o_proj.min_weight** | 0.39 |
| **attn.o_proj.min_weight_distance** | 21.84 |
| **mlp.down_proj.max_weight** | 0.87 |
| **mlp.down_proj.max_weight_position** | 28.65 |
| **mlp.down_proj.min_weight** | 0.59 |
| **mlp.down_proj.min_weight_distance** | 19.36 |

## Performance

| Metric | This model | Original model ([dphn/Dolphin3.0-Mistral-24B](https://huggingface.co/dphn/Dolphin3.0-Mistral-24B)) |
| :----- | :--------: | :---------------------------: |
| **KL divergence** | 0.0088 | 0 *(by definition)* |
| **Refusals** | 0/100 | 66/100 |

-----