The plain matrices hold on a tightly written prompt
Browse files- RELEASE_NOTES_v3.md +7 -6
RELEASE_NOTES_v3.md
CHANGED
|
@@ -54,12 +54,13 @@ That costs 0.0027 of pure-text cosine on the residual and 0.0013 on the matrix
|
|
| 54 |
which is why the 8B figures above are slightly below what a text-only corpus
|
| 55 |
would have given.
|
| 56 |
|
| 57 |
-
**Prefer the `-mlp` files
|
| 58 |
-
|
| 59 |
-
|
| 60 |
-
|
| 61 |
-
|
| 62 |
-
|
|
|
|
| 63 |
|
| 64 |
## What this does not fix, and will not
|
| 65 |
|
|
|
|
| 54 |
which is why the 8B figures above are slightly below what a text-only corpus
|
| 55 |
would have given.
|
| 56 |
|
| 57 |
+
**Prefer the `-mlp` files on the measurement, not on this scene.** They sit
|
| 58 |
+
closer to the 32B, 0.9449 against 0.9289 on the 8B. But on this prompt the five
|
| 59 |
+
renders are faithful, plain matrices included: the pose, the dress, the white
|
| 60 |
+
pieces, the cat, the straw hat, the laundry, the bouncing knee all hold on all
|
| 61 |
+
five. A tightly written prompt survives even the linear baseline, and the
|
| 62 |
+
difference between the files shows up in the numbers well before it shows up on
|
| 63 |
+
screen.
|
| 64 |
|
| 65 |
## What this does not fix, and will not
|
| 66 |
|