---
base_model:
- SC117/QwenPaw-Flash-9B-heretic-GGUF
---
Q4_K_L is based on observations of unsloth Q4_K_XL and unsloth Q4_K_M, without imatrix
```
llama-quantize \
    --tensor-type ssm_alpha=F32 \
    --tensor-type ssm_beta=F32 \
    --tensor-type ssm_out=q8_0 \
    --tensor-type attn_gate=q5_k \
    --tensor-type attn_qkv=q5_k \
    --tensor-type attn_v=q6_k \
    ./QwenPaw-Flash-9B-heretic-F16.gguf ./QwenPaw-Flash-9B-heretic-Q4_K_L.gguf Q4_K_M
```