NicoLab28 commited on
Commit
398a4fc
·
verified ·
1 Parent(s): 442c471

The plain matrices hold on a tightly written prompt

Browse files
Files changed (1) hide show
  1. RELEASE_NOTES_v3.md +7 -6
RELEASE_NOTES_v3.md CHANGED
@@ -54,12 +54,13 @@ That costs 0.0027 of pure-text cosine on the residual and 0.0013 on the matrix
54
  which is why the 8B figures above are slightly below what a text-only corpus
55
  would have given.
56
 
57
- **Prefer the `-mlp` files.** They measure closer to the 32B, 0.9449 against
58
- 0.9289 on the 8B, and on the demo scene both plain matrices get the seated pose
59
- wrong: the prompt asks for one bare leg crossed over the other and they sit her
60
- cross-legged. But the gap is narrower than that sounds — the cat, the straw hat,
61
- the laundry and the bouncing knee all come through on the plain matrices too. On
62
- this scene they missed one attribute among many, and it happened to be the pose.
 
63
 
64
  ## What this does not fix, and will not
65
 
 
54
  which is why the 8B figures above are slightly below what a text-only corpus
55
  would have given.
56
 
57
+ **Prefer the `-mlp` files on the measurement, not on this scene.** They sit
58
+ closer to the 32B, 0.9449 against 0.9289 on the 8B. But on this prompt the five
59
+ renders are faithful, plain matrices included: the pose, the dress, the white
60
+ pieces, the cat, the straw hat, the laundry, the bouncing knee all hold on all
61
+ five. A tightly written prompt survives even the linear baseline, and the
62
+ difference between the files shows up in the numbers well before it shows up on
63
+ screen.
64
 
65
  ## What this does not fix, and will not
66