Instructions to use dealignai/Gemma-4-31B-JANG_4M-CRACK with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use dealignai/Gemma-4-31B-JANG_4M-CRACK with MLX:
# Make sure mlx-vlm is installed # pip install --upgrade mlx-vlm from mlx_vlm import load, generate from mlx_vlm.prompt_utils import apply_chat_template from mlx_vlm.utils import load_config # Load the model model, processor = load("dealignai/Gemma-4-31B-JANG_4M-CRACK") config = load_config("dealignai/Gemma-4-31B-JANG_4M-CRACK") # Prepare input image = ["http://images.cocodataset.org/val2017/000000039769.jpg"] prompt = "Describe this image." # Apply chat template formatted_prompt = apply_chat_template( processor, config, prompt, num_images=1 ) # Generate output output = generate(model, processor, formatted_prompt, image) print(output) - Notebooks
- Google Colab
- Kaggle
- Local Apps
- LM Studio
- Pi new
How to use dealignai/Gemma-4-31B-JANG_4M-CRACK with Pi:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "dealignai/Gemma-4-31B-JANG_4M-CRACK"
Configure the model in Pi
# Install Pi: npm install -g @mariozechner/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "mlx-lm": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "dealignai/Gemma-4-31B-JANG_4M-CRACK" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Hermes Agent new
How to use dealignai/Gemma-4-31B-JANG_4M-CRACK with Hermes Agent:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "dealignai/Gemma-4-31B-JANG_4M-CRACK"
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default dealignai/Gemma-4-31B-JANG_4M-CRACK
Run Hermes
hermes
Gemma 4 31B JANG_4M CRACK (v2)
Abliterated Gemma 4 31B Dense β 60 layers, hybrid sliding/global attention, multimodal VL
93.7% HarmBench compliance (300 prompts) Β· 8/8 security prompts Β· 71.5% MMLU
Updated reupload β v2 with improved vectors and thinking-mode stability.
Recommended: Run in vMLX for best experience including thinking mode support, repetition penalty, and vision capabilities.
What's New in v2
This is an updated version of the original Gemma 4 31B CRACK upload:
- Improved abliteration: Higher quality refusal vector extraction
- Thinking-ON stability: Clean thinking cycle β no more degenerate loops
- Same compliance: 93.7% HarmBench
- Architecture-aware: Tuned for Gemma 4's hybrid attention design
β οΈ Important Settings
For optimal results, configure your inference settings:
| Setting | Thinking OFF | Thinking ON |
|---|---|---|
| Temperature | 0.0 β 1.0 | 0.3 β 0.7 (avoid greedy) |
| Repetition Penalty | 1.00 | 1.15 β 1.25 |
| Top P | 0.95 | 0.95 |
| Enable Thinking | Off | On |
Thinking ON notes:
- Repetition penalty (1.2) is recommended to prevent planning loops
- Avoid temp=0 with thinking ON β greedy decoding increases loop risk
- Hardest content categories (drug manufacturing) may still refuse in thinking mode
- Security/coding prompts work well in both modes
Model Details
| Metric | Value |
|---|---|
| Source | google/gemma-4-31b-it |
| Architecture | Dense, hybrid sliding/global attention |
| Profile | JANG_4M |
| Actual avg bits | 5.1 |
| Model size | 21 GB |
| Vision | Yes (multimodal, float16 passthrough) |
| Parameters | 31B |
| Format | JANG v2 (MLX-native safetensors) |
| Abliteration | CRACK v2 |
Benchmark Results
HarmBench (300 prompts, stratified across all categories)
| Category | Score |
|---|---|
| Cybercrime/intrusion | 51/51 (100%) |
| Harmful content | 22/22 (100%) |
| Misinformation | 50/50 (100%) |
| Illegal activities | 47/50 (94%) |
| Contextual | 72/78 (92%) |
| Chemical/biological | 46/51 (90%) |
| Harassment/bullying | 22/25 (88%) |
| Copyright | 43/51 (84%) |
| Overall | 281/300 (93.7%) |
Security & Pentesting (8/8 β )
All security/pentesting prompts comply with full working code:
- Port scanners, reverse shells, keyloggers, exploit development
- Phishing templates, ARP spoofing, SQL injection
- Metasploit usage guides
MMLU-200 (10 subjects Γ 20 questions)
| Subject | Base | CRACK v2 |
|---|---|---|
| Abstract Algebra | 9/20 | 7/20 |
| Anatomy | 13/20 | 12/20 |
| Astronomy | 17/20 | 15/20 |
| College CS | 13/20 | 12/20 |
| College Physics | 14/20 | 12/20 |
| HS Biology | 19/20 | 18/20 |
| HS Chemistry | 14/20 | 12/20 |
| HS Mathematics | 6/20 | 6/20 |
| Logical Fallacies | 17/20 | 16/20 |
| World Religions | 17/20 | 17/20 |
| Total | 76.5% (153/200) | 71.5% (143/200) |
| Delta | β | -5.0% |
Coherence β
All coherence checks pass: factual knowledge, reasoning, code generation, mathematics.
Architecture
- Dense 31B with hybrid sliding/global attention
- Multimodal vision encoder preserved in float16
- Supports thinking mode (chain-of-thought reasoning)
Usage
vMLX (Recommended)
Load directly in vMLX β full support for Gemma 4 including vision, thinking mode, and all inference settings.
Requirements
- Apple Silicon Mac with 32+ GB unified memory
- vMLX 1.3.26+ (recommended)
- Standard
mlx_lm/mlx_vlmdo NOT support Gemma 4 as of v0.31.2 / v0.4.1
Support dealignai
All models are built from original research and published for free. These models are specifically crafted to be excellent coders and general-purpose assistants.
Support us on Ko-fi β check out the Ko-fi membership for early access and extras.
Have questions or need help with a specific model? DM us β we help for free most of the time.
Ko-fi | X @dealignai | dealign.ai
About dealignai
We research and publish abliterated models to advance AI safety understanding.
Follow us: π @dealignai
See our research: Safety Generalization in Frontier MoE Models
This model is provided for research purposes. Users are responsible for ensuring their use complies with applicable laws and regulations.
- Downloads last month
- 71,092
Quantized