--- base_model: - kyx0r/Neona-12B base_model_relation: quantized tags: - exl3 --- ## Quantized using exllamav3 (0.0.5) quantization process. - Original model: [`kyx0r/Neona-12B`](https://huggingface.co/kyx0r/Neona-12B) - refer for more details on the model. - exllamav3: https://github.com/turboderp-org/exllamav3 --- EXL3 quants available: - 3.5 - 4.0 - 4.5 - 5.0 - 6.0 - 8.0 - - Go to "Files and versions", then click on "Main" to choose your quant