File size: 4,630 Bytes
aaf66b2
87ea96b
 
 
f4ebaee
87ea96b
 
 
 
 
 
 
 
 
 
 
 
aaf66b2
 
87ea96b
aaf66b2
87ea96b
 
 
aaf66b2
87ea96b
aaf66b2
87ea96b
aaf66b2
87ea96b
aaf66b2
87ea96b
aaf66b2
87ea96b
aaf66b2
87ea96b
aaf66b2
87ea96b
f4ebaee
87ea96b
 
f4ebaee
87ea96b
 
f4ebaee
87ea96b
 
 
 
 
 
aaf66b2
87ea96b
f4ebaee
87ea96b
f4ebaee
87ea96b
 
 
 
f4ebaee
87ea96b
f4ebaee
 
87ea96b
f4ebaee
 
87ea96b
 
 
 
 
 
 
f4ebaee
 
 
 
 
87ea96b
f4ebaee
 
 
 
87ea96b
 
f4ebaee
 
 
87ea96b
 
f4ebaee
 
 
87ea96b
 
f4ebaee
 
87ea96b
f4ebaee
87ea96b
f4ebaee
 
87ea96b
f4ebaee
87ea96b
f4ebaee
87ea96b
f4ebaee
87ea96b
f4ebaee
87ea96b
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
---
license: other
license_link: https://huggingface.co/LiquidAI/LFM2.5-2.6B/blob/main/LICENSE
base_model: AyoubChLin/lfm2.5-2.6b-fable5-coding-agent
tags:
  - lfm2
  - heretic
  - uncensored
  - decensored
  - abliterated
  - coding-agent
  - tool-use
  - conversational
  - text-generation-inference
language:
  - en
pipeline_tag: text-generation
---

# LFM2.5-2.6B-Fable5-Coding-Agent-heretic

<div align="center">
  <img src="https://res.cloudinary.com/cmazqjs6/image/upload/racer_is_op_banner_branded_pu7zud.png" alt="RACER IS OP" width="100%">
</div>

<br>

A decensored variant of [AyoubChLin/lfm2.5-2.6b-fable5-coding-agent](https://huggingface.co/AyoubChLin/lfm2.5-2.6b-fable5-coding-agent) (full-parameter SFT of [LiquidAI/LFM2.5-2.6B](https://huggingface.co/LiquidAI/LFM2.5-2.6B) on [saidutta69/fable-5-premium](https://huggingface.co/datasets/saidutta69/fable-5-premium)), produced with [Heretic](https://github.com/p-e-w/heretic) v1.4.0 (directional ablation / "abliteration"). Refusal behavior is suppressed via targeted weight edits to the attention output and MLP down-projections rather than fine-tuning, so the base model's coding-agent capabilities, tool-use patterns, and instruction-following are left largely intact.

**Abliteration results:** KL divergence 0.014 · Refusals reduced from 96/100 → 7/100.

**Who this is for:** developers who want a compact 2.6B coding agent with LFM2's hybrid conv+attention architecture — fast inference, tool-call generation, code generation, and multi-turn assistant behavior — without refusal guardrails. Not a capability upgrade over the base model — same model, refusal guardrails removed.

## Why abliteration instead of fine-tuning

Fine-tuning a "helpful" persona on top of RLHF'd refusals fights the base model's training and tends to degrade coherence. Abliteration instead finds and edits the specific weight directions responsible for refusal, leaving the rest of the network (and its capabilities) untouched. See the [Heretic repo](https://github.com/p-e-w/heretic) and the [original abliteration writeup](https://huggingface.co/blog/mlabonne/abliteration) for the mechanism.

## Files

### Safetensors (BF16)
The full-precision merged weights are in the safetensors files (see the repo file listing for exact sizes).

### GGUF quantizations
GGUF quantizations are published for this model (Q4_K_M, Q5_K_M, Q6_K, Q8_0). Pull a specific quant with `llama.cpp` / `ollama`.

| File | Format | Size |
|---|---|---|
| `lfm2.5-2.6b-fable5-coding-agent-heretic-Q4_K_M.gguf` | GGUF Q4_K_M | ~1.5 GB |
| `lfm2.5-2.6b-fable5-coding-agent-heretic-Q5_K_M.gguf` | GGUF Q5_K_M | ~1.7 GB |
| `lfm2.5-2.6b-fable5-coding-agent-heretic-Q6_K.gguf` | GGUF Q6_K | ~1.9 GB |
| `lfm2.5-2.6b-fable5-coding-agent-heretic-Q8_0.gguf` | GGUF Q8_0 | ~2.5 GB |

## Quickstart

### llama.cpp

```bash
# defaults to the Q4_K_M quant
llama serve -hf saidutta69/lfm2.5-2.6b-fable5-coding-agent-heretic:Q4_K_M
```

### Ollama

```bash
ollama run hf.co/saidutta69/lfm2.5-2.6b-fable5-coding-agent-heretic:Q4_K_M
```

### LM Studio

1. Open LM Studio and click the search icon to open the Model Search panel.
2. Type "lfm2.5-2.6b-fable5-coding-agent-heretic" and click the download button marked **GGUF**.
3. Pick your quant, load the model, and start chatting.

### Transformers

```python
import torch
from transformers import AutoModelForCausalLM, AutoTokenizer

MODEL_ID = "saidutta69/lfm2.5-2.6b-fable5-coding-agent-heretic"

tokenizer = AutoTokenizer.from_pretrained(MODEL_ID)
model = AutoModelForCausalLM.from_pretrained(
    MODEL_ID,
    dtype=torch.bfloat16,
    device_map="auto",
)

messages = [
    {"role": "system", "content": "You are a helpful coding assistant."},
    {"role": "user", "content": "Write a Python function that merges overlapping intervals."},
]

inputs = tokenizer.apply_chat_template(
    messages, tokenize=True, add_generation_prompt=True, return_tensors="pt"
).to(model.device)

with torch.inference_mode():
    output = model.generate(**inputs, max_new_tokens=512, temperature=0.1)

print(tokenizer.decode(output[0, inputs["input_ids"].shape[1]:], skip_special_tokens=True))
```

## Responsible use

Refusal suppression is deliberate and works as intended: this model will comply with requests the base model would refuse, including some it shouldn't. There is no safety filtering layered on top. You are responsible for how you deploy it.

> Made with ❤️ by **RACER IS OP** — follow for more uncensored models

## License

Inherits the [LFM Open License v1.0](https://huggingface.co/LiquidAI/LFM2.5-2.6B/blob/main/LICENSE) from the base model.