NicoLab28 commited on
Commit
b0a5a59
·
verified ·
1 Parent(s): 4838201

The -mlp residuals in fp16: half the download, and half the VRAM with node 0.1.4

Browse files
README.md CHANGED
@@ -23,7 +23,13 @@ library_name: comfyui
23
  These files are useless on their own. They require the custom node:
24
  **[github.com/nicolab28/ComfyUI-ClipProj](https://github.com/nicolab28/ComfyUI-ClipProj)**
25
 
26
- ## Update to node 0.1.3, and re-download
 
 
 
 
 
 
27
 
28
  Two reasons, one of them silent.
29
 
 
23
  These files are useless on their own. They require the custom node:
24
  **[github.com/nicolab28/ComfyUI-ClipProj](https://github.com/nicolab28/ComfyUI-ClipProj)**
25
 
26
+ ## Update to node 0.1.4, and re-download the `-mlp` matrices
27
+
28
+ **The `-mlp` matrices are now fp16 and half the size.** The residual network was published in fp32 and the node forced fp32 on load regardless of the file, so storing it in half precision would have halved the download and saved nothing at all in VRAM. Node 0.1.4 keeps a residual in whatever precision it was saved in, converting its inputs and outputs around it instead. Measured: 240 MB on the card instead of 480 for the 4B, 288 instead of 576 for the 8B. The files here have been replaced under the same names — re-download them, and take 0.1.4 with them, because an older node will load them and cast them straight back up to fp32.
29
+
30
+ Node 0.1.4 also frees the card **before** loading a replacement encoder rather than after, which matters if yours is tight enough that two encoders will not sit on it at once.
31
+
32
+ ## Also in 0.1.3
33
 
34
  Two reasons, one of them silent.
35
 
mmh3-4b-ClipProj-celeb-mlp.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2444c0a70d0a02231a36806b5433701b48e13579b42e830588c3f4fafff846f3
3
- size 555914408
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:275b389991276532d969dbb32f91ce67e170549873e61819cfec52a770660699
3
+ size 304213176
mmh3-4b-ClipProj-mlp.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:063356d362d8b5dfd322d4ac432733a26dccb2bed33cc78733b271ac1b90e4f3
3
- size 555914392
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:866275725e93811cd63cd54a0b3b6696dfdcd9caca7e554587b3aa11a971c461
3
+ size 304213160
mmh3-8b-ClipProj-celeb-mlp.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:33f59910b8e557ce92f7434da6609026c1e9d26f73d799b0751297fbf5bd0e97
3
- size 688047272
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:47f9691406e2e9f801d9ea5e4ee332431cb6c5b1232da7b044d1a8226bd66bde
3
+ size 386014392
mmh3-8b-ClipProj-mlp.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:3b26d6319e47f59f293396dc8b59ddab5e29e676dfa081b4678684ff78c4e259
3
- size 688047272
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6191a62b746321aa08e5a40c4902eefe93c8a11f572baf2d75281f6de3b18450
3
+ size 386014392