Ttimms commited on
Commit
c22c4d2
·
1 Parent(s): a102634

Fix stale zaya1-godspeed GitHub links (repo renamed to zaya1-nvfp4-w4a4)

Browse files
Files changed (1) hide show
  1. README.md +6 -6
README.md CHANGED
@@ -73,7 +73,7 @@ failing too) — neither currently offers a fix that preserves CUDA graphs for
73
  this failure mode. See [Pape, Evertz & Schönherr (arXiv:2605.19537)](https://arxiv.org/abs/2605.19537)
74
  for the general phenomenon of backend-dependent correctness drift in LLM
75
  serving. Full sweep, coherence re-verification, and citations in `RESEARCH.md`
76
- and `ROADMAP.md` on the [GitHub repo](https://github.com/t-timms/zaya1-godspeed).
77
 
78
  **Set `--enforce-eager` (or `enforce_eager=True`) when serving this checkpoint.**
79
  It is the only configuration confirmed to produce coherent output.
@@ -122,7 +122,7 @@ checkpoint, more so than the accuracy difference.
122
  > attempts to reproduce it on this project's own SM120 hardware hit the same
123
  > non-deterministic hang each time, ruling out the model and toolkit version
124
  > as causes; looks like a WSL2/driver-level issue. Not resolved as of
125
- > 2026-08-14 — see [GitHub repo](https://github.com/t-timms/zaya1-godspeed)
126
  > `RESEARCH.md` §5.16 for the full diagnostic log.
127
  >
128
  > **Update, same day:** the gap likely has a principled cause independent of
@@ -224,13 +224,13 @@ calibrate through the fake-quant `nn.Linear.forward` wrapper; and the NVFP4
224
  global-scale convention (`2688 / max_abs`, divisor form, block scales
225
  pre-multiplied) is undocumented — getting it wrong produces silent pad-token
226
  collapse, not an error. Full root-cause writeup in `RESEARCH.md` on the
227
- [GitHub repo](https://github.com/t-timms/zaya1-godspeed).
228
 
229
  ## Usage
230
 
231
  Requires vLLM built from source with SM120 NVFP4 CUTLASS kernels (stock wheels
232
  don't include them) — see the
233
- [reproduce steps](https://github.com/t-timms/zaya1-godspeed#reproduce).
234
  Inference must run in `bfloat16` (not fp16/fp32).
235
 
236
  ```bash
@@ -247,7 +247,7 @@ See "Known issue" above before serving without it.
247
  decoding, validated **2.2× faster on coding-edit prompts** (no gain on
248
  free-form generation, since there's no prompt/output overlap to exploit).
249
  Detail: `RESEARCH.md` §5.18. The exact command above is
250
- [`scripts/serve.sh`](https://github.com/t-timms/zaya1-godspeed/blob/master/scripts/serve.sh)
251
  in the repo.
252
 
253
  ## Evaluation
@@ -268,7 +268,7 @@ in the repo.
268
  > will serve you better.
269
  > **MMLU-Pro is 0-shot and is not comparable to Zyphra's 5-shot 74.2%** — that
270
  > gap is a protocol difference, not quantization damage. Full analysis:
271
- > [`RESEARCH.md` §5.22](https://github.com/t-timms/zaya1-godspeed/blob/master/RESEARCH.md).
272
 
273
  Budget-forced GPQA-Diamond using an s1-style harness that caps the reasoning
274
  trace and scores only the closed answer — stock lm-eval harnesses score near
 
73
  this failure mode. See [Pape, Evertz & Schönherr (arXiv:2605.19537)](https://arxiv.org/abs/2605.19537)
74
  for the general phenomenon of backend-dependent correctness drift in LLM
75
  serving. Full sweep, coherence re-verification, and citations in `RESEARCH.md`
76
+ and `ROADMAP.md` on the [GitHub repo](https://github.com/t-timms/zaya1-nvfp4-w4a4).
77
 
78
  **Set `--enforce-eager` (or `enforce_eager=True`) when serving this checkpoint.**
79
  It is the only configuration confirmed to produce coherent output.
 
122
  > attempts to reproduce it on this project's own SM120 hardware hit the same
123
  > non-deterministic hang each time, ruling out the model and toolkit version
124
  > as causes; looks like a WSL2/driver-level issue. Not resolved as of
125
+ > 2026-08-14 — see [GitHub repo](https://github.com/t-timms/zaya1-nvfp4-w4a4)
126
  > `RESEARCH.md` §5.16 for the full diagnostic log.
127
  >
128
  > **Update, same day:** the gap likely has a principled cause independent of
 
224
  global-scale convention (`2688 / max_abs`, divisor form, block scales
225
  pre-multiplied) is undocumented — getting it wrong produces silent pad-token
226
  collapse, not an error. Full root-cause writeup in `RESEARCH.md` on the
227
+ [GitHub repo](https://github.com/t-timms/zaya1-nvfp4-w4a4).
228
 
229
  ## Usage
230
 
231
  Requires vLLM built from source with SM120 NVFP4 CUTLASS kernels (stock wheels
232
  don't include them) — see the
233
+ [reproduce steps](https://github.com/t-timms/zaya1-nvfp4-w4a4#reproduce).
234
  Inference must run in `bfloat16` (not fp16/fp32).
235
 
236
  ```bash
 
247
  decoding, validated **2.2× faster on coding-edit prompts** (no gain on
248
  free-form generation, since there's no prompt/output overlap to exploit).
249
  Detail: `RESEARCH.md` §5.18. The exact command above is
250
+ [`scripts/serve.sh`](https://github.com/t-timms/zaya1-nvfp4-w4a4/blob/master/scripts/serve.sh)
251
  in the repo.
252
 
253
  ## Evaluation
 
268
  > will serve you better.
269
  > **MMLU-Pro is 0-shot and is not comparable to Zyphra's 5-shot 74.2%** — that
270
  > gap is a protocol difference, not quantization damage. Full analysis:
271
+ > [`RESEARCH.md` §5.22](https://github.com/t-timms/zaya1-nvfp4-w4a4/blob/master/RESEARCH.md).
272
 
273
  Budget-forced GPQA-Diamond using an s1-style harness that caps the reasoning
274
  trace and scores only the closed answer — stock lm-eval harnesses score near