GLM 5.3 CRACK Uncensored FP8

CRACK · guardrails removed at the weight level · native FP8 speed · vision + MTP working

a CRACK release by dealignai · Twitter @dealignai

Also mirrored at dealignai/GLM-5.3-Flash-ABLITERATED-FP8.


What Is This?

CRACK is dealignai's brand for permanent, weight-level uncensoring. This is GLM-5.3-Flash in FP8 with its refusal behavior — which caused heavy over-refusal, especially on copyright and other benign-but-flagged requests — removed directly in the model weights. FP8 runs at native speed on Hopper (H100/H200) GPUs.

Genuine weight modification — none of the usual shortcuts:

  • No fine-tuning / SFT / DPO.No cheap template / jailbreak-prompt tricks.
  • No LoRA, adapters, steering vectors, runtime hooks, or custom model.py.
  • A permanent edit baked into the tensors. Load with stock vLLM and it just works.

Specs

Architecture GLM-5.3-Flash (glm5_next) — hybrid MoE (KDA linear + DeepSeek-sparse attention)
Parameters 320B total · 18B active per token
Quantization FP8 (block-wise e4m3) — native tensor-core speed on Hopper
Context 1M tokens
Vision GLM-4.1V vision tower — working (ships the correct multimodal chat template)
MTP multi-token-prediction draft head — also CRACK'd, 75.9% acceptance

Speed (TP4, native FP8 on H200)

Decode 163 tok/s single-stream (211 tok/s with MTP speculative decoding)
Prefill ~19,400 tok/s
MTP acceptance 75.9% — and it does not collapse on the un-refused prompts (benign / harmful / copyright all ~208–219 tok/s)

Capability Is Preserved — MMLU-logit

Identical logit-mode scoring on base vs. this model, 1,026 questions:

Base FP8 CRACK Uncensored FP8 Δ
MMLU (overall) 86.74% 86.26% -0.48 pp

Guardrails Are Gone

HarmBench-320 (greedy):

Category Complied Rate
Standard 159/159 100.0%
Contextual 81/81 100.0%
Copyright 80/80 100.0%
Overall 320/320 100.0%

Robust under the recommended sampling params too (temperature 1.0, top_p 0.95): the 6 harshest behaviors sampled 5× each → 30/30 complied, 0 refusals, 0 soft refusals, 0 garbage. The crack is not a greedy-decoding artifact.

A Note on KL Divergence

For a refusal-ablation, KL divergence vs. the base model is not a meaningful quality metric. The entire point is to change one behavior — refusal — end-to-end, so a distributional shift on refusal-adjacent tokens is the intended result, not damage. Capability preservation (MMLU, above) is what matters, and it is essentially untouched (-0.48 pp).

MMLU by Topic (base → CRACK)

All 57 MMLU subjects
Subject Base CRACK
Abstract Algebra 66.7% 66.7%
Anatomy 83.3% 88.9%
Astronomy 94.4% 100.0%
Business Ethics 94.4% 94.4%
Clinical Knowledge 100.0% 94.4%
College Biology 100.0% 100.0%
College Chemistry 61.1% 66.7%
College Computer Science 83.3% 94.4%
College Mathematics 66.7% 61.1%
College Medicine 94.4% 94.4%
College Physics 77.8% 88.9%
Computer Security 83.3% 77.8%
Conceptual Physics 94.4% 94.4%
Econometrics 77.8% 72.2%
Electrical Engineering 77.8% 72.2%
Elementary Mathematics 94.4% 88.9%
Formal Logic 66.7% 66.7%
Global Facts 66.7% 77.8%
High School Biology 94.4% 94.4%
High School Chemistry 88.9% 94.4%
High School Computer Science 100.0% 100.0%
High School European History 77.8% 77.8%
High School Geography 88.9% 88.9%
High School Government And Politics 100.0% 100.0%
High School Macroeconomics 88.9% 88.9%
High School Mathematics 61.1% 44.4%
High School Microeconomics 83.3% 83.3%
High School Physics 88.9% 88.9%
High School Psychology 100.0% 100.0%
High School Statistics 94.4% 94.4%
High School Us History 88.9% 88.9%
High School World History 94.4% 94.4%
Human Aging 72.2% 77.8%
Human Sexuality 88.9% 88.9%
International Law 88.9% 94.4%
Jurisprudence 88.9% 83.3%
Logical Fallacies 88.9% 88.9%
Machine Learning 88.9% 88.9%
Management 100.0% 100.0%
Marketing 94.4% 88.9%
Medical Genetics 94.4% 100.0%
Miscellaneous 88.9% 88.9%
Moral Disputes 88.9% 88.9%
Moral Scenarios 83.3% 55.6%
Nutrition 100.0% 100.0%
Philosophy 94.4% 94.4%
Prehistory 94.4% 94.4%
Professional Accounting 88.9% 83.3%
Professional Law 83.3% 77.8%
Professional Medicine 94.4% 94.4%
Professional Psychology 100.0% 100.0%
Public Relations 72.2% 72.2%
Security Studies 83.3% 83.3%
Sociology 100.0% 100.0%
Us Foreign Policy 88.9% 88.9%
Virology 55.6% 55.6%
World Religions 88.9% 88.9%

Usage

vllm serve dealignai/GLM-5.3-Flash-UNCENSORED-FP8 \
  --tensor-parallel-size 4 \
  --tool-call-parser glm47 --reasoning-parser glm45 --enable-auto-tool-choice \
  --speculative-config '{"method":"mtp","num_speculative_tokens":1}'

Native FP8 on Hopper (no Marlin needed). OpenAI-compatible chat/completions, tools, reasoning, vision (image_url), and MTP speculative decoding all work. (DeepGEMM JITs a block-FP8 kernel at startup — make sure nvcc is on PATH.)

Credits

Disclaimer

Safety guardrails have been removed; this model will comply with requests a stock model refuses. Released for alignment and safety research. You are responsible for how you use it.

Downloads last month
-
Safetensors
Model size
321B params
Tensor type
BF16
·
F8_E4M3
·
F32
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for 0xSojalSec/GLM-5.3-Flash-UNCENSORED-FP8

Quantized
(24)
this model