Update README.md
Browse files
README.md
CHANGED
|
@@ -6,11 +6,11 @@ tags:
|
|
| 6 |
- exl3
|
| 7 |
---
|
| 8 |
|
| 9 |
-
## Quantized using
|
| 10 |
|
| 11 |
- Original model: [`kyx0r/Neona-12B`](https://huggingface.co/kyx0r/Neona-12B) - refer for more details on the model.
|
| 12 |
- exllamav3: https://github.com/turboderp-org/exllamav3
|
| 13 |
---
|
| 14 |
EXL3 quants available:
|
| 15 |
-
- 3.5 - 4.0 - 4.5 - 5.0
|
| 16 |
- Go to "Files and versions", then click on "Main" to choose your quant
|
|
|
|
| 6 |
- exl3
|
| 7 |
---
|
| 8 |
|
| 9 |
+
## Quantized using exllamav3 (0.0.5) quantization process.
|
| 10 |
|
| 11 |
- Original model: [`kyx0r/Neona-12B`](https://huggingface.co/kyx0r/Neona-12B) - refer for more details on the model.
|
| 12 |
- exllamav3: https://github.com/turboderp-org/exllamav3
|
| 13 |
---
|
| 14 |
EXL3 quants available:
|
| 15 |
+
- 3.5 - 4.0 - 4.5 - 5.0 - 6.0 - 8.0 -
|
| 16 |
- Go to "Files and versions", then click on "Main" to choose your quant
|