---
base_model: Carlosian/Qwen3.5-35B-A3B-Abliterated
base_model_relation: quantized
library_name: gguf
pipeline_tag: text-generation
tags:
- gguf
- quantized
- abliterated
- uncensored
- moe
- llama.cpp
license: other
---

# Qwen3.5-35B-A3B-Abliterated — GGUF quant ladder

Quantized GGUF builds of [`Carlosian/Qwen3.5-35B-A3B-Abliterated`](https://huggingface.co/Carlosian/Qwen3.5-35B-A3B-Abliterated) for llama.cpp / Ollama / LM Studio.

| Quant | Typical use |
|-------|-------------|
| Q2_K | smallest / extreme low VRAM |
| Q3_K_S / Q3_K_M | low VRAM |
| Q4_0 / Q4_K_S / Q4_K_M | **recommended default (Q4_K_M)** |
| Q5_K_S / Q5_K_M | higher quality |
| Q6_K | near-lossless |
| Q8_0 | highest quality quant |

Built with llama.cpp on Thunder Compute (A100). Generated 2026-07-20.
Uploaded incrementally per-quant to manage disk (35B MoE ladder is large).