---
base_model: TheDrummer/Anubis-70B-v1.1
library_name: transformers
base_model_relation: quantized
quantized_by: Sinensis
pipeline_tag: text-generation

---
## AWQ quantization of [TheDrummer/Anubis-70B-v1.1](https://huggingface.co/TheDrummer/Anubis-70B-v1.1)

quantization_config:  
bits: 4  
group_size: 128  
quant_method: awq  
version: gemm  
zero_point: true