Instructions to use bkideas/LFM2.5-8B-A1B-MLX-nvfp4 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use bkideas/LFM2.5-8B-A1B-MLX-nvfp4 with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] huggingface-cli download --local-dir LFM2.5-8B-A1B-MLX-nvfp4 bkideas/LFM2.5-8B-A1B-MLX-nvfp4
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
Update README.md
Browse files
README.md
CHANGED
|
@@ -38,4 +38,6 @@ NVFP4 reduces memory usage by ~65% and increases generation speed by ~1.6–1.8
|
|
| 38 |
|
| 39 |
### **Practical Impact**
|
| 40 |
For chat, summarization, and coding, NVFP4 behaves almost identically to the BF16 model.
|
| 41 |
-
For math/logic‑heavy tasks, BF16 remains slightly more accurate.
|
|
|
|
|
|
|
|
|
| 38 |
|
| 39 |
### **Practical Impact**
|
| 40 |
For chat, summarization, and coding, NVFP4 behaves almost identically to the BF16 model.
|
| 41 |
+
For math/logic‑heavy tasks, BF16 remains slightly more accurate.
|
| 42 |
+
|
| 43 |
+
<img src="/bkideas/Qwen2.5-Coder-3B-MLX-nvfp4/resolve/main/benchmark.svg" alt="Benchmark table" width="100%" />
|