hugruby commited on
Commit
129a725
·
verified ·
1 Parent(s): 4e0ad6f

Model card: clarify length-budget notes (max-prompt-tokens for no-draft, max-seq-length wording)

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -121,10 +121,10 @@ python scripts/train.py \
121
  |---|---|---|---|
122
  | mismatched-wrong | 7168 | 4096 | 3072 |
123
  | matched-wrong | 7168 | 4096 | 3072 |
124
- | no-draft | 7168 | 4096 | disabled (equivalent to 3,072, as all prompts are short) |
125
  | **mismatched-correct** | 8192 | 4096 | disabled |
126
 
127
- For a strict apple-to-apple comparison, `mismatched-correct` should have used `--max-seq-length 7168` and `--max-prompt-tokens 3072` like the other three variants; the larger 8,192 with the cap left off was an omission. The effect should be negligible though — only **6 of 8,888** prompts exceed 3,072 tokens (longest 3,317), so for the other 8,882 the run is identical to a 7,168 / 3,072 setup. For those 6 the prompt is left untruncated, but the 4,096 max-completion length is still respected and the sequence runs only slightly past 7,168 (at most 3,317 + 4,096 = 7,413, well under 8,192). But to train a precise apple-to-apple version yourself, change `--max-seq-length 8192` to `7168` and add `--max-prompt-tokens 3072`.
128
 
129
  ## Files
130
 
 
121
  |---|---|---|---|
122
  | mismatched-wrong | 7168 | 4096 | 3072 |
123
  | matched-wrong | 7168 | 4096 | 3072 |
124
+ | no-draft | 7168 | 4096 | disabled (but it is equivalent to 3,072, as all prompts are short and no truncation) |
125
  | **mismatched-correct** | 8192 | 4096 | disabled |
126
 
127
+ For a strict apple-to-apple comparison, `mismatched-correct` should have used `--max-seq-length 7168` and `--max-prompt-tokens 3072` like the other three variants; the larger 8,192 with the max-prompt-tokens cap left off was an omission. The effect should be negligible though — only **6 of 8,888** prompts exceed 3,072 tokens (longest 3,317), and for the other 8,882 the run is identical to a 7,168 / 3,072 setup. For those 6 the prompt is left untruncated, but the 4,096 max-completion length is still respected and max-seq-length runs only slightly past 7,168 (at most 3,317 + 4,096 = 7,413, well under 8,192). But to train a precise apple-to-apple version yourself, for mismatched-correct, change `--max-seq-length 8192` to `7168` and add `--max-prompt-tokens 3072`. For the no-draft variant, it is better to add `--max-prompt-tokens 3072` explicitly as well.
128
 
129
  ## Files
130