orbitquant_unets / creaprompt_UNet_OrbitQuant_W3A4_projio_report.txt
ApacheOne's picture
Upload creaprompt_UNet_OrbitQuant_W3A4_projio_report.txt
0a8f13c verified
Raw
History Blame
94.1 kB
OrbitQuant SDXL UNet-only custom export W3A4
========================================================================================================================
Source: /content/creaprompt_sdxl/creapromptLightning_creapromtHypersdxlV1.safetensors
Output: /content/creaprompt_sdxl/orbitquant_unet/creaprompt_UNet_OrbitQuant_W3A4_projio.safetensors
Output file size: 1,550,820,232 / 1.444 GiB
Original UNet
------------------------------------------------------------------------------------------------------------------------
UNet keys: 1,680
UNet params: 2,567,463,684
UNet FP16: 5,134,927,368 / 4.782 GiB
Targeted OrbitQuant weights
------------------------------------------------------------------------------------------------------------------------
Target keys: 722
Target params: 2,207,744,000
Target FP16: 4,415,488,000 / 4.112 GiB
Target share: 85.989298% of UNet params
Input dims: [640, 1280, 2048, 2560, 5120]
Custom stored size estimate
------------------------------------------------------------------------------------------------------------------------
Untouched kept UNet bytes: 719,439,368 / 686.111 MiB
Packed quantized index bytes: 827,904,000 / 789.551 MiB
Row norm bytes: 2,872,320 / 2.739 MiB
Estimate without metadata: 1,550,215,688 / 1.444 GiB
Actual safetensors file: 1,550,820,232 / 1.444 GiB
Saved from original UNet FP16: 3,584,107,136 / 3.338 GiB
UNet shrink vs FP16: 69.7986%
Quantized keys
------------------------------------------------------------------------------------------------------------------------
model.diffusion_model.input_blocks.4.1.proj_in.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.input_blocks.4.1.proj_out.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.input_blocks.4.1.transformer_blocks.0.attn1.to_k.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.input_blocks.4.1.transformer_blocks.0.attn1.to_out.0.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.input_blocks.4.1.transformer_blocks.0.attn1.to_q.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.input_blocks.4.1.transformer_blocks.0.attn1.to_v.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.input_blocks.4.1.transformer_blocks.0.attn2.to_k.weight shape=[640, 2048] input_dim=2048 output_dim=640
model.diffusion_model.input_blocks.4.1.transformer_blocks.0.attn2.to_out.0.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.input_blocks.4.1.transformer_blocks.0.attn2.to_q.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.input_blocks.4.1.transformer_blocks.0.attn2.to_v.weight shape=[640, 2048] input_dim=2048 output_dim=640
model.diffusion_model.input_blocks.4.1.transformer_blocks.0.ff.net.0.proj.weight shape=[5120, 640] input_dim=640 output_dim=5120
model.diffusion_model.input_blocks.4.1.transformer_blocks.0.ff.net.2.weight shape=[640, 2560] input_dim=2560 output_dim=640
model.diffusion_model.input_blocks.4.1.transformer_blocks.1.attn1.to_k.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.input_blocks.4.1.transformer_blocks.1.attn1.to_out.0.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.input_blocks.4.1.transformer_blocks.1.attn1.to_q.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.input_blocks.4.1.transformer_blocks.1.attn1.to_v.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.input_blocks.4.1.transformer_blocks.1.attn2.to_k.weight shape=[640, 2048] input_dim=2048 output_dim=640
model.diffusion_model.input_blocks.4.1.transformer_blocks.1.attn2.to_out.0.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.input_blocks.4.1.transformer_blocks.1.attn2.to_q.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.input_blocks.4.1.transformer_blocks.1.attn2.to_v.weight shape=[640, 2048] input_dim=2048 output_dim=640
model.diffusion_model.input_blocks.4.1.transformer_blocks.1.ff.net.0.proj.weight shape=[5120, 640] input_dim=640 output_dim=5120
model.diffusion_model.input_blocks.4.1.transformer_blocks.1.ff.net.2.weight shape=[640, 2560] input_dim=2560 output_dim=640
model.diffusion_model.input_blocks.5.1.proj_in.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.input_blocks.5.1.proj_out.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.input_blocks.5.1.transformer_blocks.0.attn1.to_k.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.input_blocks.5.1.transformer_blocks.0.attn1.to_out.0.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.input_blocks.5.1.transformer_blocks.0.attn1.to_q.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.input_blocks.5.1.transformer_blocks.0.attn1.to_v.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.input_blocks.5.1.transformer_blocks.0.attn2.to_k.weight shape=[640, 2048] input_dim=2048 output_dim=640
model.diffusion_model.input_blocks.5.1.transformer_blocks.0.attn2.to_out.0.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.input_blocks.5.1.transformer_blocks.0.attn2.to_q.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.input_blocks.5.1.transformer_blocks.0.attn2.to_v.weight shape=[640, 2048] input_dim=2048 output_dim=640
model.diffusion_model.input_blocks.5.1.transformer_blocks.0.ff.net.0.proj.weight shape=[5120, 640] input_dim=640 output_dim=5120
model.diffusion_model.input_blocks.5.1.transformer_blocks.0.ff.net.2.weight shape=[640, 2560] input_dim=2560 output_dim=640
model.diffusion_model.input_blocks.5.1.transformer_blocks.1.attn1.to_k.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.input_blocks.5.1.transformer_blocks.1.attn1.to_out.0.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.input_blocks.5.1.transformer_blocks.1.attn1.to_q.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.input_blocks.5.1.transformer_blocks.1.attn1.to_v.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.input_blocks.5.1.transformer_blocks.1.attn2.to_k.weight shape=[640, 2048] input_dim=2048 output_dim=640
model.diffusion_model.input_blocks.5.1.transformer_blocks.1.attn2.to_out.0.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.input_blocks.5.1.transformer_blocks.1.attn2.to_q.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.input_blocks.5.1.transformer_blocks.1.attn2.to_v.weight shape=[640, 2048] input_dim=2048 output_dim=640
model.diffusion_model.input_blocks.5.1.transformer_blocks.1.ff.net.0.proj.weight shape=[5120, 640] input_dim=640 output_dim=5120
model.diffusion_model.input_blocks.5.1.transformer_blocks.1.ff.net.2.weight shape=[640, 2560] input_dim=2560 output_dim=640
model.diffusion_model.input_blocks.7.1.proj_in.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.proj_out.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.0.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.0.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.0.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.0.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.0.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.0.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.0.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.0.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.0.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.input_blocks.7.1.transformer_blocks.0.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.1.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.1.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.1.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.1.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.1.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.1.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.1.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.1.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.1.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.input_blocks.7.1.transformer_blocks.1.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.2.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.2.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.2.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.2.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.2.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.2.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.2.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.2.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.2.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.input_blocks.7.1.transformer_blocks.2.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.3.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.3.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.3.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.3.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.3.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.3.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.3.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.3.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.3.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.input_blocks.7.1.transformer_blocks.3.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.4.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.4.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.4.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.4.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.4.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.4.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.4.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.4.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.4.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.input_blocks.7.1.transformer_blocks.4.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.5.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.5.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.5.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.5.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.5.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.5.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.5.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.5.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.5.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.input_blocks.7.1.transformer_blocks.5.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.6.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.6.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.6.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.6.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.6.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.6.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.6.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.6.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.6.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.input_blocks.7.1.transformer_blocks.6.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.7.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.7.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.7.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.7.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.7.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.7.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.7.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.7.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.7.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.input_blocks.7.1.transformer_blocks.7.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.8.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.8.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.8.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.8.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.8.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.8.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.8.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.8.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.8.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.input_blocks.7.1.transformer_blocks.8.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.9.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.9.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.9.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.9.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.9.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.9.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.9.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.9.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.9.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.input_blocks.7.1.transformer_blocks.9.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.input_blocks.8.1.proj_in.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.proj_out.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.0.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.0.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.0.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.0.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.0.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.0.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.0.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.0.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.0.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.input_blocks.8.1.transformer_blocks.0.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.1.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.1.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.1.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.1.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.1.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.1.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.1.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.1.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.1.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.input_blocks.8.1.transformer_blocks.1.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.2.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.2.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.2.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.2.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.2.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.2.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.2.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.2.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.2.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.input_blocks.8.1.transformer_blocks.2.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.3.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.3.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.3.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.3.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.3.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.3.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.3.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.3.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.3.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.input_blocks.8.1.transformer_blocks.3.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.4.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.4.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.4.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.4.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.4.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.4.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.4.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.4.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.4.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.input_blocks.8.1.transformer_blocks.4.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.5.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.5.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.5.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.5.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.5.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.5.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.5.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.5.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.5.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.input_blocks.8.1.transformer_blocks.5.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.6.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.6.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.6.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.6.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.6.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.6.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.6.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.6.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.6.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.input_blocks.8.1.transformer_blocks.6.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.7.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.7.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.7.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.7.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.7.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.7.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.7.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.7.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.7.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.input_blocks.8.1.transformer_blocks.7.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.8.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.8.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.8.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.8.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.8.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.8.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.8.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.8.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.8.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.input_blocks.8.1.transformer_blocks.8.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.9.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.9.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.9.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.9.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.9.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.9.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.9.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.9.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.9.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.input_blocks.8.1.transformer_blocks.9.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.middle_block.1.proj_in.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.proj_out.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.0.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.0.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.0.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.0.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.0.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.0.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.0.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.0.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.0.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.middle_block.1.transformer_blocks.0.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.1.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.1.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.1.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.1.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.1.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.1.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.1.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.1.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.1.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.middle_block.1.transformer_blocks.1.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.2.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.2.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.2.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.2.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.2.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.2.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.2.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.2.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.2.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.middle_block.1.transformer_blocks.2.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.3.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.3.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.3.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.3.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.3.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.3.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.3.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.3.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.3.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.middle_block.1.transformer_blocks.3.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.4.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.4.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.4.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.4.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.4.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.4.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.4.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.4.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.4.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.middle_block.1.transformer_blocks.4.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.5.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.5.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.5.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.5.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.5.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.5.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.5.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.5.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.5.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.middle_block.1.transformer_blocks.5.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.6.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.6.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.6.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.6.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.6.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.6.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.6.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.6.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.6.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.middle_block.1.transformer_blocks.6.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.7.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.7.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.7.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.7.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.7.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.7.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.7.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.7.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.7.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.middle_block.1.transformer_blocks.7.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.8.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.8.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.8.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.8.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.8.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.8.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.8.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.8.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.8.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.middle_block.1.transformer_blocks.8.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.9.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.9.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.9.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.9.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.9.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.9.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.9.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.9.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.9.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.middle_block.1.transformer_blocks.9.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.0.1.proj_in.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.proj_out.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.0.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.0.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.0.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.0.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.0.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.0.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.0.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.0.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.0.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.output_blocks.0.1.transformer_blocks.0.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.1.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.1.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.1.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.1.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.1.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.1.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.1.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.1.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.1.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.output_blocks.0.1.transformer_blocks.1.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.2.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.2.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.2.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.2.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.2.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.2.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.2.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.2.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.2.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.output_blocks.0.1.transformer_blocks.2.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.3.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.3.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.3.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.3.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.3.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.3.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.3.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.3.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.3.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.output_blocks.0.1.transformer_blocks.3.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.4.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.4.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.4.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.4.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.4.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.4.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.4.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.4.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.4.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.output_blocks.0.1.transformer_blocks.4.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.5.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.5.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.5.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.5.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.5.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.5.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.5.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.5.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.5.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.output_blocks.0.1.transformer_blocks.5.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.6.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.6.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.6.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.6.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.6.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.6.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.6.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.6.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.6.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.output_blocks.0.1.transformer_blocks.6.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.7.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.7.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.7.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.7.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.7.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.7.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.7.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.7.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.7.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.output_blocks.0.1.transformer_blocks.7.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.8.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.8.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.8.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.8.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.8.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.8.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.8.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.8.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.8.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.output_blocks.0.1.transformer_blocks.8.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.9.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.9.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.9.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.9.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.9.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.9.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.9.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.9.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.9.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.output_blocks.0.1.transformer_blocks.9.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.1.1.proj_in.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.proj_out.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.0.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.0.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.0.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.0.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.0.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.0.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.0.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.0.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.0.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.output_blocks.1.1.transformer_blocks.0.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.1.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.1.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.1.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.1.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.1.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.1.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.1.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.1.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.1.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.output_blocks.1.1.transformer_blocks.1.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.2.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.2.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.2.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.2.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.2.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.2.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.2.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.2.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.2.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.output_blocks.1.1.transformer_blocks.2.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.3.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.3.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.3.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.3.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.3.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.3.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.3.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.3.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.3.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.output_blocks.1.1.transformer_blocks.3.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.4.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.4.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.4.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.4.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.4.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.4.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.4.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.4.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.4.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.output_blocks.1.1.transformer_blocks.4.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.5.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.5.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.5.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.5.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.5.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.5.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.5.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.5.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.5.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.output_blocks.1.1.transformer_blocks.5.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.6.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.6.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.6.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.6.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.6.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.6.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.6.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.6.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.6.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.output_blocks.1.1.transformer_blocks.6.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.7.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.7.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.7.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.7.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.7.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.7.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.7.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.7.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.7.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.output_blocks.1.1.transformer_blocks.7.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.8.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.8.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.8.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.8.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.8.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.8.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.8.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.8.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.8.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.output_blocks.1.1.transformer_blocks.8.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.9.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.9.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.9.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.9.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.9.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.9.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.9.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.9.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.9.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.output_blocks.1.1.transformer_blocks.9.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.2.1.proj_in.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.proj_out.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.0.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.0.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.0.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.0.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.0.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.0.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.0.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.0.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.0.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.output_blocks.2.1.transformer_blocks.0.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.1.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.1.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.1.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.1.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.1.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.1.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.1.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.1.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.1.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.output_blocks.2.1.transformer_blocks.1.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.2.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.2.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.2.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.2.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.2.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.2.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.2.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.2.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.2.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.output_blocks.2.1.transformer_blocks.2.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.3.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.3.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.3.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.3.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.3.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.3.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.3.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.3.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.3.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.output_blocks.2.1.transformer_blocks.3.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.4.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.4.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.4.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.4.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.4.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.4.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.4.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.4.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.4.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.output_blocks.2.1.transformer_blocks.4.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.5.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.5.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.5.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.5.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.5.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.5.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.5.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.5.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.5.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.output_blocks.2.1.transformer_blocks.5.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.6.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.6.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.6.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.6.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.6.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.6.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.6.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.6.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.6.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.output_blocks.2.1.transformer_blocks.6.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.7.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.7.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.7.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.7.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.7.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.7.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.7.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.7.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.7.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.output_blocks.2.1.transformer_blocks.7.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.8.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.8.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.8.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.8.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.8.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.8.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.8.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.8.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.8.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.output_blocks.2.1.transformer_blocks.8.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.9.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.9.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.9.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.9.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.9.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.9.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.9.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.9.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.9.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.output_blocks.2.1.transformer_blocks.9.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.3.1.proj_in.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.3.1.proj_out.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.3.1.transformer_blocks.0.attn1.to_k.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.3.1.transformer_blocks.0.attn1.to_out.0.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.3.1.transformer_blocks.0.attn1.to_q.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.3.1.transformer_blocks.0.attn1.to_v.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.3.1.transformer_blocks.0.attn2.to_k.weight shape=[640, 2048] input_dim=2048 output_dim=640
model.diffusion_model.output_blocks.3.1.transformer_blocks.0.attn2.to_out.0.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.3.1.transformer_blocks.0.attn2.to_q.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.3.1.transformer_blocks.0.attn2.to_v.weight shape=[640, 2048] input_dim=2048 output_dim=640
model.diffusion_model.output_blocks.3.1.transformer_blocks.0.ff.net.0.proj.weight shape=[5120, 640] input_dim=640 output_dim=5120
model.diffusion_model.output_blocks.3.1.transformer_blocks.0.ff.net.2.weight shape=[640, 2560] input_dim=2560 output_dim=640
model.diffusion_model.output_blocks.3.1.transformer_blocks.1.attn1.to_k.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.3.1.transformer_blocks.1.attn1.to_out.0.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.3.1.transformer_blocks.1.attn1.to_q.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.3.1.transformer_blocks.1.attn1.to_v.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.3.1.transformer_blocks.1.attn2.to_k.weight shape=[640, 2048] input_dim=2048 output_dim=640
model.diffusion_model.output_blocks.3.1.transformer_blocks.1.attn2.to_out.0.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.3.1.transformer_blocks.1.attn2.to_q.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.3.1.transformer_blocks.1.attn2.to_v.weight shape=[640, 2048] input_dim=2048 output_dim=640
model.diffusion_model.output_blocks.3.1.transformer_blocks.1.ff.net.0.proj.weight shape=[5120, 640] input_dim=640 output_dim=5120
model.diffusion_model.output_blocks.3.1.transformer_blocks.1.ff.net.2.weight shape=[640, 2560] input_dim=2560 output_dim=640
model.diffusion_model.output_blocks.4.1.proj_in.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.4.1.proj_out.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.4.1.transformer_blocks.0.attn1.to_k.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.4.1.transformer_blocks.0.attn1.to_out.0.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.4.1.transformer_blocks.0.attn1.to_q.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.4.1.transformer_blocks.0.attn1.to_v.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.4.1.transformer_blocks.0.attn2.to_k.weight shape=[640, 2048] input_dim=2048 output_dim=640
model.diffusion_model.output_blocks.4.1.transformer_blocks.0.attn2.to_out.0.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.4.1.transformer_blocks.0.attn2.to_q.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.4.1.transformer_blocks.0.attn2.to_v.weight shape=[640, 2048] input_dim=2048 output_dim=640
model.diffusion_model.output_blocks.4.1.transformer_blocks.0.ff.net.0.proj.weight shape=[5120, 640] input_dim=640 output_dim=5120
model.diffusion_model.output_blocks.4.1.transformer_blocks.0.ff.net.2.weight shape=[640, 2560] input_dim=2560 output_dim=640
model.diffusion_model.output_blocks.4.1.transformer_blocks.1.attn1.to_k.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.4.1.transformer_blocks.1.attn1.to_out.0.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.4.1.transformer_blocks.1.attn1.to_q.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.4.1.transformer_blocks.1.attn1.to_v.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.4.1.transformer_blocks.1.attn2.to_k.weight shape=[640, 2048] input_dim=2048 output_dim=640
model.diffusion_model.output_blocks.4.1.transformer_blocks.1.attn2.to_out.0.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.4.1.transformer_blocks.1.attn2.to_q.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.4.1.transformer_blocks.1.attn2.to_v.weight shape=[640, 2048] input_dim=2048 output_dim=640
model.diffusion_model.output_blocks.4.1.transformer_blocks.1.ff.net.0.proj.weight shape=[5120, 640] input_dim=640 output_dim=5120
model.diffusion_model.output_blocks.4.1.transformer_blocks.1.ff.net.2.weight shape=[640, 2560] input_dim=2560 output_dim=640
model.diffusion_model.output_blocks.5.1.proj_in.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.5.1.proj_out.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.5.1.transformer_blocks.0.attn1.to_k.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.5.1.transformer_blocks.0.attn1.to_out.0.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.5.1.transformer_blocks.0.attn1.to_q.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.5.1.transformer_blocks.0.attn1.to_v.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.5.1.transformer_blocks.0.attn2.to_k.weight shape=[640, 2048] input_dim=2048 output_dim=640
model.diffusion_model.output_blocks.5.1.transformer_blocks.0.attn2.to_out.0.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.5.1.transformer_blocks.0.attn2.to_q.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.5.1.transformer_blocks.0.attn2.to_v.weight shape=[640, 2048] input_dim=2048 output_dim=640
model.diffusion_model.output_blocks.5.1.transformer_blocks.0.ff.net.0.proj.weight shape=[5120, 640] input_dim=640 output_dim=5120
model.diffusion_model.output_blocks.5.1.transformer_blocks.0.ff.net.2.weight shape=[640, 2560] input_dim=2560 output_dim=640
model.diffusion_model.output_blocks.5.1.transformer_blocks.1.attn1.to_k.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.5.1.transformer_blocks.1.attn1.to_out.0.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.5.1.transformer_blocks.1.attn1.to_q.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.5.1.transformer_blocks.1.attn1.to_v.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.5.1.transformer_blocks.1.attn2.to_k.weight shape=[640, 2048] input_dim=2048 output_dim=640
model.diffusion_model.output_blocks.5.1.transformer_blocks.1.attn2.to_out.0.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.5.1.transformer_blocks.1.attn2.to_q.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.5.1.transformer_blocks.1.attn2.to_v.weight shape=[640, 2048] input_dim=2048 output_dim=640
model.diffusion_model.output_blocks.5.1.transformer_blocks.1.ff.net.0.proj.weight shape=[5120, 640] input_dim=640 output_dim=5120
model.diffusion_model.output_blocks.5.1.transformer_blocks.1.ff.net.2.weight shape=[640, 2560] input_dim=2560 output_dim=640