Update README.md
Browse files
README.md
CHANGED
|
@@ -8,9 +8,9 @@ base_model:
|
|
| 8 |
|
| 9 |
Note: This model is experimental. While the quantization completed the resulting model does not seem to behave properly. I'm leaving this in case someone wants to look at it and see what it does but I think a different approach may be needed for Ouro architecture models.
|
| 10 |
|
| 11 |
-
**Format:** NVFP4 — weights & activations quantized to FP4 with dual scaling.
|
| 12 |
-
**Base model:** `ByteDance/Ouro-2.6B-Thinking`
|
| 13 |
-
**How it was made:** One-shot calibration with LLM Compressor (NVFP4 recipe), long-seq calibration with Rombo-Org/Optimized_Reasoning.
|
| 14 |
|
| 15 |
> Notes: Keep `lm_head` in high precision; calibrate on long, domain-relevant sequences.
|
| 16 |
|
|
|
|
| 8 |
|
| 9 |
Note: This model is experimental. While the quantization completed the resulting model does not seem to behave properly. I'm leaving this in case someone wants to look at it and see what it does but I think a different approach may be needed for Ouro architecture models.
|
| 10 |
|
| 11 |
+
**Format:** NVFP4 — weights & activations quantized to FP4 with dual scaling.
|
| 12 |
+
**Base model:** `ByteDance/Ouro-2.6B-Thinking`
|
| 13 |
+
**How it was made:** One-shot calibration with LLM Compressor (NVFP4 recipe), long-seq calibration with Rombo-Org/Optimized_Reasoning.
|
| 14 |
|
| 15 |
> Notes: Keep `lm_head` in high precision; calibrate on long, domain-relevant sequences.
|
| 16 |
|