Update README.md
Browse files
README.md
CHANGED
|
@@ -21,7 +21,7 @@ language:
|
|
| 21 |
- it
|
| 22 |
---
|
| 23 |
|
| 24 |
-
# Voxtral-Mini-3B-2507
|
| 25 |
|
| 26 |
GGUF builds of [mistralai/Voxtral-Mini-3B-2507](https://huggingface.co/mistralai/Voxtral-Mini-3B-2507)
|
| 27 |
for [voxtral.cpp](https://github.com/andrijdavid/voxtral.cpp), a ggml-based C++
|
|
@@ -36,7 +36,7 @@ decoder that transcribes by generating text tokens and very fast for batch / lon
|
|
| 36 |
| --- | --- |
|
| 37 |
| `Q8_0` | near-lossless, largest |
|
| 38 |
| `Q6_K`, `Q5_K`, `Q5_1`, `Q5_0` | high quality |
|
| 39 |
-
| **`Q4_K_M`** | **recommended**
|
| 40 |
| `Q4_K`, `Q4_1`, `Q4_0` | smaller |
|
| 41 |
| `Q3_K` | smallest usable (some quality loss) |
|
| 42 |
|
|
|
|
| 21 |
- it
|
| 22 |
---
|
| 23 |
|
| 24 |
+
# Voxtral-Mini-3B-2507-GGUF
|
| 25 |
|
| 26 |
GGUF builds of [mistralai/Voxtral-Mini-3B-2507](https://huggingface.co/mistralai/Voxtral-Mini-3B-2507)
|
| 27 |
for [voxtral.cpp](https://github.com/andrijdavid/voxtral.cpp), a ggml-based C++
|
|
|
|
| 36 |
| --- | --- |
|
| 37 |
| `Q8_0` | near-lossless, largest |
|
| 38 |
| `Q6_K`, `Q5_K`, `Q5_1`, `Q5_0` | high quality |
|
| 39 |
+
| **`Q4_K_M`** | **recommended** best size/quality trade-off |
|
| 40 |
| `Q4_K`, `Q4_1`, `Q4_0` | smaller |
|
| 41 |
| `Q3_K` | smallest usable (some quality loss) |
|
| 42 |
|