Instructions to use huihui-ai/Huihui-Qwen3-Coder-30B-A3B-Instruct-abliterated with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use huihui-ai/Huihui-Qwen3-Coder-30B-A3B-Instruct-abliterated with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="huihui-ai/Huihui-Qwen3-Coder-30B-A3B-Instruct-abliterated")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("huihui-ai/Huihui-Qwen3-Coder-30B-A3B-Instruct-abliterated")
model = AutoModelForCausalLM.from_pretrained("huihui-ai/Huihui-Qwen3-Coder-30B-A3B-Instruct-abliterated")
messages = [
    {"role": "user", "content": "Who are you?"},
]
inputs = tokenizer.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=40)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use huihui-ai/Huihui-Qwen3-Coder-30B-A3B-Instruct-abliterated with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "huihui-ai/Huihui-Qwen3-Coder-30B-A3B-Instruct-abliterated"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "huihui-ai/Huihui-Qwen3-Coder-30B-A3B-Instruct-abliterated",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/huihui-ai/Huihui-Qwen3-Coder-30B-A3B-Instruct-abliterated

SGLang

How to use huihui-ai/Huihui-Qwen3-Coder-30B-A3B-Instruct-abliterated with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "huihui-ai/Huihui-Qwen3-Coder-30B-A3B-Instruct-abliterated" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "huihui-ai/Huihui-Qwen3-Coder-30B-A3B-Instruct-abliterated",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "huihui-ai/Huihui-Qwen3-Coder-30B-A3B-Instruct-abliterated" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "huihui-ai/Huihui-Qwen3-Coder-30B-A3B-Instruct-abliterated",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use huihui-ai/Huihui-Qwen3-Coder-30B-A3B-Instruct-abliterated with Docker Model Runner:
```
docker model run hf.co/huihui-ai/Huihui-Qwen3-Coder-30B-A3B-Instruct-abliterated
```

model abliteration request.

by spinochenza - opened Aug 12, 2025

Discussion

spinochenza

Aug 12, 2025

hi.thanks for your great works.i tested qwen3coder and its performance are amazing.
please abliterate davidau coding models.
DavidAU/Qwen3-Coder-42B-A3B-Instruct-TOTAL-RECALL-MASTER-CODER-M
DavidAU/Qwen3-Esper3-Reasoning-CODER-Instruct-21B-Brainstorm20x-128k-ctx

armand0e

Aug 18, 2025

YES total recall & esper3 are beasts!! going to request them from @DavidAU as well

huihui-ai

Owner Aug 19, 2025

The two models haven't received many likes. Is it necessary to proceed?

armand0e

Aug 19, 2025

•

edited Aug 19, 2025

The two models haven't received many likes. Is it necessary to proceed?

I myself have only used DavidAU/Qwen3-53B-A3B-2507-TOTAL-RECALL-v2-MASTER-CODER. So cannot speak for the two he mentioned specifically.

However I have replaced claude sonnet 4 in my coding agents DavidAU/Qwen3-53B-A3B-2507-TOTAL-RECALL-v2-MASTER-CODER and DavidAU/Qwen3-42B-A3B-2507-Thinking-TOTAL-RECALL-v2-Medium-MASTER-CODER, couldn't be happier.

So to answer your question "Is it necessary?"; no, but if the compute isn't too expensive for you (time or money), why not :)

huihui-ai

Owner Aug 19, 2025

Regarding your questions, please refer to https://x.com/support_huihui/status/1957628113275457649.

spinochenza

Aug 19, 2025

•

edited Aug 19, 2025

These models are really great for coding, but the limitations they have prevent them from showing their power. There's really no need to remove the limitations, but it would be great if you could, and I'd be grateful.
@huihui-ai

DavidAU

Aug 19, 2025

•

edited Aug 19, 2025

Quick note; If there is an abliterated version of the "core" model in any Brainstorm modified model, then I can use this version with Brainstorm,
and rebuild the model / upload ; in these cases "2507"s of Qwen models and "Coder" 30BA3B.

Likewise with Esper3, by Valiant labs.

Added note:
The 40x (and to some degree 20X) Brainstorm already de-censors (somewhat) the model.
This is not as strong as abliteration or fine tune(s) on a decensored dataset.

spinochenza

Aug 19, 2025

@DavidAU huihui.ai abliterated the core models that can be used on your great works.

DavidAU

Aug 22, 2025

Update;

Source and quants up at :

https://huggingface.co/DavidAU/Qwen3-42B-A3B-2507-Thinking-Abliterated-uncensored-TOTAL-RECALL-v2-Medium-MASTER-CODER

T1-Core

Aug 22, 2025

I will be sure to like all of the models associated with huihui-ai. You're hands down the best thing on huggingface. I can shout you out on IG if you'd like - @officialmarionormil. DM me.

DavidAU

Aug 23, 2025

@T1-Core

I will what I can do RE: Brainstorming @huihui-ai 's models ; adding to the list.
Huihui ablit models are excellent.

armand0e

Aug 23, 2025

@DavidAU

I Love this model way too much

Update;

Source and quants up at :

https://huggingface.co/DavidAU/Qwen3-42B-A3B-2507-Thinking-Abliterated-uncensored-TOTAL-RECALL-v2-Medium-MASTER-CODER

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment