Fix stale zaya1-godspeed GitHub links (repo renamed to zaya1-nvfp4-w4a4)
Browse files
README.md
CHANGED
|
@@ -73,7 +73,7 @@ failing too) — neither currently offers a fix that preserves CUDA graphs for
|
|
| 73 |
this failure mode. See [Pape, Evertz & Schönherr (arXiv:2605.19537)](https://arxiv.org/abs/2605.19537)
|
| 74 |
for the general phenomenon of backend-dependent correctness drift in LLM
|
| 75 |
serving. Full sweep, coherence re-verification, and citations in `RESEARCH.md`
|
| 76 |
-
and `ROADMAP.md` on the [GitHub repo](https://github.com/t-timms/zaya1-
|
| 77 |
|
| 78 |
**Set `--enforce-eager` (or `enforce_eager=True`) when serving this checkpoint.**
|
| 79 |
It is the only configuration confirmed to produce coherent output.
|
|
@@ -122,7 +122,7 @@ checkpoint, more so than the accuracy difference.
|
|
| 122 |
> attempts to reproduce it on this project's own SM120 hardware hit the same
|
| 123 |
> non-deterministic hang each time, ruling out the model and toolkit version
|
| 124 |
> as causes; looks like a WSL2/driver-level issue. Not resolved as of
|
| 125 |
-
> 2026-08-14 — see [GitHub repo](https://github.com/t-timms/zaya1-
|
| 126 |
> `RESEARCH.md` §5.16 for the full diagnostic log.
|
| 127 |
>
|
| 128 |
> **Update, same day:** the gap likely has a principled cause independent of
|
|
@@ -224,13 +224,13 @@ calibrate through the fake-quant `nn.Linear.forward` wrapper; and the NVFP4
|
|
| 224 |
global-scale convention (`2688 / max_abs`, divisor form, block scales
|
| 225 |
pre-multiplied) is undocumented — getting it wrong produces silent pad-token
|
| 226 |
collapse, not an error. Full root-cause writeup in `RESEARCH.md` on the
|
| 227 |
-
[GitHub repo](https://github.com/t-timms/zaya1-
|
| 228 |
|
| 229 |
## Usage
|
| 230 |
|
| 231 |
Requires vLLM built from source with SM120 NVFP4 CUTLASS kernels (stock wheels
|
| 232 |
don't include them) — see the
|
| 233 |
-
[reproduce steps](https://github.com/t-timms/zaya1-
|
| 234 |
Inference must run in `bfloat16` (not fp16/fp32).
|
| 235 |
|
| 236 |
```bash
|
|
@@ -247,7 +247,7 @@ See "Known issue" above before serving without it.
|
|
| 247 |
decoding, validated **2.2× faster on coding-edit prompts** (no gain on
|
| 248 |
free-form generation, since there's no prompt/output overlap to exploit).
|
| 249 |
Detail: `RESEARCH.md` §5.18. The exact command above is
|
| 250 |
-
[`scripts/serve.sh`](https://github.com/t-timms/zaya1-
|
| 251 |
in the repo.
|
| 252 |
|
| 253 |
## Evaluation
|
|
@@ -268,7 +268,7 @@ in the repo.
|
|
| 268 |
> will serve you better.
|
| 269 |
> **MMLU-Pro is 0-shot and is not comparable to Zyphra's 5-shot 74.2%** — that
|
| 270 |
> gap is a protocol difference, not quantization damage. Full analysis:
|
| 271 |
-
> [`RESEARCH.md` §5.22](https://github.com/t-timms/zaya1-
|
| 272 |
|
| 273 |
Budget-forced GPQA-Diamond using an s1-style harness that caps the reasoning
|
| 274 |
trace and scores only the closed answer — stock lm-eval harnesses score near
|
|
|
|
| 73 |
this failure mode. See [Pape, Evertz & Schönherr (arXiv:2605.19537)](https://arxiv.org/abs/2605.19537)
|
| 74 |
for the general phenomenon of backend-dependent correctness drift in LLM
|
| 75 |
serving. Full sweep, coherence re-verification, and citations in `RESEARCH.md`
|
| 76 |
+
and `ROADMAP.md` on the [GitHub repo](https://github.com/t-timms/zaya1-nvfp4-w4a4).
|
| 77 |
|
| 78 |
**Set `--enforce-eager` (or `enforce_eager=True`) when serving this checkpoint.**
|
| 79 |
It is the only configuration confirmed to produce coherent output.
|
|
|
|
| 122 |
> attempts to reproduce it on this project's own SM120 hardware hit the same
|
| 123 |
> non-deterministic hang each time, ruling out the model and toolkit version
|
| 124 |
> as causes; looks like a WSL2/driver-level issue. Not resolved as of
|
| 125 |
+
> 2026-08-14 — see [GitHub repo](https://github.com/t-timms/zaya1-nvfp4-w4a4)
|
| 126 |
> `RESEARCH.md` §5.16 for the full diagnostic log.
|
| 127 |
>
|
| 128 |
> **Update, same day:** the gap likely has a principled cause independent of
|
|
|
|
| 224 |
global-scale convention (`2688 / max_abs`, divisor form, block scales
|
| 225 |
pre-multiplied) is undocumented — getting it wrong produces silent pad-token
|
| 226 |
collapse, not an error. Full root-cause writeup in `RESEARCH.md` on the
|
| 227 |
+
[GitHub repo](https://github.com/t-timms/zaya1-nvfp4-w4a4).
|
| 228 |
|
| 229 |
## Usage
|
| 230 |
|
| 231 |
Requires vLLM built from source with SM120 NVFP4 CUTLASS kernels (stock wheels
|
| 232 |
don't include them) — see the
|
| 233 |
+
[reproduce steps](https://github.com/t-timms/zaya1-nvfp4-w4a4#reproduce).
|
| 234 |
Inference must run in `bfloat16` (not fp16/fp32).
|
| 235 |
|
| 236 |
```bash
|
|
|
|
| 247 |
decoding, validated **2.2× faster on coding-edit prompts** (no gain on
|
| 248 |
free-form generation, since there's no prompt/output overlap to exploit).
|
| 249 |
Detail: `RESEARCH.md` §5.18. The exact command above is
|
| 250 |
+
[`scripts/serve.sh`](https://github.com/t-timms/zaya1-nvfp4-w4a4/blob/master/scripts/serve.sh)
|
| 251 |
in the repo.
|
| 252 |
|
| 253 |
## Evaluation
|
|
|
|
| 268 |
> will serve you better.
|
| 269 |
> **MMLU-Pro is 0-shot and is not comparable to Zyphra's 5-shot 74.2%** — that
|
| 270 |
> gap is a protocol difference, not quantization damage. Full analysis:
|
| 271 |
+
> [`RESEARCH.md` §5.22](https://github.com/t-timms/zaya1-nvfp4-w4a4/blob/master/RESEARCH.md).
|
| 272 |
|
| 273 |
Budget-forced GPQA-Diamond using an s1-style harness that caps the reasoning
|
| 274 |
trace and scores only the closed answer — stock lm-eval harnesses score near
|