---
license: apache-2.0
base_model:
- Nimbz/Gemma-4-Gembrain-31B
tags:
- merge
- mergekit
- reasoning
- non-reasoning
- creative writing
- roleplay
- uncensored
- 31B
- gemma-4
- heretic
- uncensored
- decensored
- abliterated
- ara
---
๐จโ ๏ธ I HAVE REACHED HUGGING FACE'S FREE STORAGE LIMIT โ ๏ธ๐จ
I can no longer upload new models unless I can cover the cost of additional storage.
I host 70+ free models as an independent contributor and this work is unpaid.
Without your support, no more new models can be uploaded.
๐ Patreon (Monthly) |
โ Ko-fi (One-time)
Every contribution goes directly toward Hugging Face storage fees to keep models free for everyone.
---
### **87% fewer refusals** (13/100 Uncensored vs 99/100 Original) while preserving model quality (0.0186 KL divergence).
## โค๏ธ Support My Work
Creating these models takes significant time, work and compute. If you find them useful consider supporting me:

| Platform | Link | What you get |
|----------|------|--------------|
| ๐ Patreon | [Monthly support](https://patreon.com/LLMfan46) | Priority model requests |
| โ Ko-fi | [One-time tip](https://ko-fi.com/llmfan46) | My eternal gratitude |
Your help will motivate me and would go into further improving my workflow and coverings fees for storage, compute and may even help uncensoring bigger model with rental Cloud GPUs.
-----
# This is a decensored version of [Nimbz/Gemma-4-Gembrain-31B](https://huggingface.co/Nimbz/Gemma-4-Gembrain-31B), made using [Heretic](https://github.com/p-e-w/heretic) v1.2.0 with the [Arbitrary-Rank Ablation (ARA)](https://github.com/p-e-w/heretic/pull/211) method
## Abliteration parameters
| Parameter | Value |
| :-------- | :---: |
| **start_layer_index** | 5 |
| **end_layer_index** | 60 |
| **preserve_good_behavior_weight** | 0.9776 |
| **steer_bad_behavior_weight** | 0.0002 |
| **overcorrect_relative_weight** | 1.0158 |
| **neighbor_count** | 15 |
## Targeted components
* attn.o_proj
## Performance
| Metric | This model | Original model ([Gemma-4-Gembrain-31B](https://huggingface.co/Nimbz/Gemma-4-Gembrain-31B)) |
| :----- | :--------: | :---------------------------: |
| **KL divergence** |
ADHERENCEIMPROVED
SWIPE VARIETYINCREASED
CREATIVE PROSEPRESERVED
๐ง About The Model
Gembrain-31B is a synthesis of several models, including Gemsicle-31B as important ingredient. The goal of this release was to stabilize and improve the initial Gemsicle-31B, but also to enhance its logical and lateral thinking, both with and without reasoning.
***
It's build to create the most unhinged narratives and construct image prompts about anything accordingly to a given structure with high precision.
***
Expect creative swipe variance, unique and non-robotic prose, and sharper instruction adherence.
๐๏ธ Samplers
| Temperature |
1.0 |
| Top-K |
0 |
| Top-P |
0.95 |
| Min-P |
0.03 |
| DRY Multiplier |
0.8 |
| DRY Base |
1.75 |
| DRY Allowed Length |
10 |
| Optional: Adaptive-P Target |
0.6 |
| Optional: Adaptive-P Decay |
0.5 |
๐ซ GGUF Quants
| Quant | Size | Download Link |
| :--- | :--- | :--- |
| **Q4_K_S** | `17.8 GB` | [Click](https://huggingface.co/Nimbz/Gemma-4-Gembrain-31B-GGUF/blob/main/Gembrain-31B-Q4_K_S.gguf) |
| **Q4_K_M** | `18.7 GB` | [Click](https://huggingface.co/Nimbz/Gemma-4-Gembrain-31B-GGUF/blob/main/Gembrain-31B-Q4_K_M.gguf) |
| **Q5_K_S** | `21.3 GB` | [Click](https://huggingface.co/Nimbz/Gemma-4-Gembrain-31B-GGUF/blob/main/Gembrain-31B-Q5_K_S.gguf) |
| **Q5_K_M** | `21.8 GB` | [Click](https://huggingface.co/Nimbz/Gemma-4-Gembrain-31B-GGUF/blob/main/Gembrain-31B-Q5_K_M.gguf) |
| **Q6_K** | `25.2 GB` | [Click](https://huggingface.co/Nimbz/Gemma-4-Gembrain-31B-GGUF/blob/main/Gembrain-31B-Q6_K.gguf) |
| **Q8_0** | `32.6 GB` | [Click](https://huggingface.co/Nimbz/Gemma-4-Gembrain-31B-GGUF/blob/main/Gemsicle-31B-Q8_0.gguf) |
๐ฎ Prompt Format
[**Please refer to the original google/gemma-4-31b-it for the correct chat template.**](https://huggingface.co/google/gemma-4-31B-it#2-thinking-mode-configuration)
Let your frontend handle the chat template if possible (e.g., Chat Completion in SillyTavern).
**For Reasoning:** Add `<|think|>` at the very beginning of the system prompt. Thinking happens between `<|channel>thought\n` and
`` tags.
```text
<|turn>system
<|think|>
You are a helpful assistant
<|turn>user
Hello
<|turn>model
Hi there
<|turn>user
How are you?
<|turn>model
```
๐งช Merge Details
This model was systematically created through a five-stage process of priming models for their given purpose and merging the results:
Phase 01: breadcrumbs_ties
Gemopus X MeroMero
```
models:
- model: ./G4-MeroMero-31B
- model: ./G4-Gemopus-4-31B-it
merge_method: breadcrumbs_ties
base_model: ./G4-31B-it
parameters:
density: 0.85
weight: 0.5
int8_mask: true
dtype: bfloat16
```
Phase 02: slerp
GarnetV2 X Musica-v1
```
models:
- model: ./G4-Gemma4-GarnetV2-31B
- model: ./G4-31B-Musica-v1
merge_method: slerp
base_model: ./G4-Gemma4-GarnetV2-31B
parameters:
t:
- value: 0.6
dtype: bfloat16
```
Phase 03: della_linear
Gemsicle X Gemma-4-31B-it-heretic-ara
```
models:
- model: ./Gemsicle-31B
parameters:
weight: 1.0
- model: ./G4-gemma-4-31b-it-heretic-ara
parameters:
weight: 0.75
density: 0.65
merge_method: della_linear
base_model: ./G4-31B-it
parameters:
weight: 1.0
normalize: false
epsilon: 0.05
lambda: 1.0
dtype: bfloat16
```
Phase 04: model_stock
Phase 01 X Phase 02 X Phase 03
```
models:
- model: ./phase01_breadcrumbs_ties
- model: ./phase02_slerp
merge_method: model_stock
base_model: ./phase03_della_linear
dtype: bfloat16
tokenizer_source: "base"
```
Phase 05: arcee_fusion
Gemsicle X Phase 04
```
models:
- model: ./Gemsicle-31B
- model: ./phase04_model_stock
merge_method: arcee_fusion
base_model: ./Gemsicle-31B
dtype: bfloat16
tokenizer_source: "base"
```
๐ Credits & Honors
The Open-Source Community: For providing the brilliant base models and fine-tunes that made this synthesis possible.
The BeaverAI Community: The people on the BeaverAI Discord - Without your help I wouldn't do all that.
Mergekit: Once again thank you Arcee AI for the great and easy to use mergekit! And thanks to zerofota and their fork for Gemma 4 support.
Ateron: Big kudos for providing me with the first steps for merging models and your relentless testing and support.
Google Gemini: For once again helping me to craft this specific model card.