OrbitQuant SDXL UNet-only custom export W3A4
========================================================================================================================
Source: /content/creaprompt_sdxl/creapromptLightning_creapromtHypersdxlV1.safetensors
Output: /content/creaprompt_sdxl/orbitquant_unet/creaprompt_UNet_OrbitQuant_W3A4_projio.safetensors
Output file size: 1,550,820,232 / 1.444 GiB

Original UNet
------------------------------------------------------------------------------------------------------------------------
UNet keys:   1,680
UNet params: 2,567,463,684
UNet FP16:   5,134,927,368 / 4.782 GiB

Targeted OrbitQuant weights
------------------------------------------------------------------------------------------------------------------------
Target keys:   722
Target params: 2,207,744,000
Target FP16:   4,415,488,000 / 4.112 GiB
Target share:  85.989298% of UNet params
Input dims:    [640, 1280, 2048, 2560, 5120]

Custom stored size estimate
------------------------------------------------------------------------------------------------------------------------
Untouched kept UNet bytes:       719,439,368 / 686.111 MiB
Packed quantized index bytes:    827,904,000 / 789.551 MiB
Row norm bytes:                  2,872,320 / 2.739 MiB
Estimate without metadata:       1,550,215,688 / 1.444 GiB
Actual safetensors file:         1,550,820,232 / 1.444 GiB
Saved from original UNet FP16:   3,584,107,136 / 3.338 GiB
UNet shrink vs FP16:             69.7986%

Quantized keys
------------------------------------------------------------------------------------------------------------------------
model.diffusion_model.input_blocks.4.1.proj_in.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.input_blocks.4.1.proj_out.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.input_blocks.4.1.transformer_blocks.0.attn1.to_k.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.input_blocks.4.1.transformer_blocks.0.attn1.to_out.0.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.input_blocks.4.1.transformer_blocks.0.attn1.to_q.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.input_blocks.4.1.transformer_blocks.0.attn1.to_v.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.input_blocks.4.1.transformer_blocks.0.attn2.to_k.weight shape=[640, 2048] input_dim=2048 output_dim=640
model.diffusion_model.input_blocks.4.1.transformer_blocks.0.attn2.to_out.0.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.input_blocks.4.1.transformer_blocks.0.attn2.to_q.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.input_blocks.4.1.transformer_blocks.0.attn2.to_v.weight shape=[640, 2048] input_dim=2048 output_dim=640
model.diffusion_model.input_blocks.4.1.transformer_blocks.0.ff.net.0.proj.weight shape=[5120, 640] input_dim=640 output_dim=5120
model.diffusion_model.input_blocks.4.1.transformer_blocks.0.ff.net.2.weight shape=[640, 2560] input_dim=2560 output_dim=640
model.diffusion_model.input_blocks.4.1.transformer_blocks.1.attn1.to_k.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.input_blocks.4.1.transformer_blocks.1.attn1.to_out.0.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.input_blocks.4.1.transformer_blocks.1.attn1.to_q.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.input_blocks.4.1.transformer_blocks.1.attn1.to_v.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.input_blocks.4.1.transformer_blocks.1.attn2.to_k.weight shape=[640, 2048] input_dim=2048 output_dim=640
model.diffusion_model.input_blocks.4.1.transformer_blocks.1.attn2.to_out.0.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.input_blocks.4.1.transformer_blocks.1.attn2.to_q.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.input_blocks.4.1.transformer_blocks.1.attn2.to_v.weight shape=[640, 2048] input_dim=2048 output_dim=640
model.diffusion_model.input_blocks.4.1.transformer_blocks.1.ff.net.0.proj.weight shape=[5120, 640] input_dim=640 output_dim=5120
model.diffusion_model.input_blocks.4.1.transformer_blocks.1.ff.net.2.weight shape=[640, 2560] input_dim=2560 output_dim=640
model.diffusion_model.input_blocks.5.1.proj_in.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.input_blocks.5.1.proj_out.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.input_blocks.5.1.transformer_blocks.0.attn1.to_k.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.input_blocks.5.1.transformer_blocks.0.attn1.to_out.0.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.input_blocks.5.1.transformer_blocks.0.attn1.to_q.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.input_blocks.5.1.transformer_blocks.0.attn1.to_v.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.input_blocks.5.1.transformer_blocks.0.attn2.to_k.weight shape=[640, 2048] input_dim=2048 output_dim=640
model.diffusion_model.input_blocks.5.1.transformer_blocks.0.attn2.to_out.0.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.input_blocks.5.1.transformer_blocks.0.attn2.to_q.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.input_blocks.5.1.transformer_blocks.0.attn2.to_v.weight shape=[640, 2048] input_dim=2048 output_dim=640
model.diffusion_model.input_blocks.5.1.transformer_blocks.0.ff.net.0.proj.weight shape=[5120, 640] input_dim=640 output_dim=5120
model.diffusion_model.input_blocks.5.1.transformer_blocks.0.ff.net.2.weight shape=[640, 2560] input_dim=2560 output_dim=640
model.diffusion_model.input_blocks.5.1.transformer_blocks.1.attn1.to_k.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.input_blocks.5.1.transformer_blocks.1.attn1.to_out.0.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.input_blocks.5.1.transformer_blocks.1.attn1.to_q.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.input_blocks.5.1.transformer_blocks.1.attn1.to_v.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.input_blocks.5.1.transformer_blocks.1.attn2.to_k.weight shape=[640, 2048] input_dim=2048 output_dim=640
model.diffusion_model.input_blocks.5.1.transformer_blocks.1.attn2.to_out.0.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.input_blocks.5.1.transformer_blocks.1.attn2.to_q.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.input_blocks.5.1.transformer_blocks.1.attn2.to_v.weight shape=[640, 2048] input_dim=2048 output_dim=640
model.diffusion_model.input_blocks.5.1.transformer_blocks.1.ff.net.0.proj.weight shape=[5120, 640] input_dim=640 output_dim=5120
model.diffusion_model.input_blocks.5.1.transformer_blocks.1.ff.net.2.weight shape=[640, 2560] input_dim=2560 output_dim=640
model.diffusion_model.input_blocks.7.1.proj_in.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.proj_out.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.0.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.0.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.0.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.0.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.0.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.0.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.0.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.0.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.0.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.input_blocks.7.1.transformer_blocks.0.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.1.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.1.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.1.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.1.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.1.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.1.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.1.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.1.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.1.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.input_blocks.7.1.transformer_blocks.1.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.2.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.2.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.2.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.2.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.2.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.2.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.2.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.2.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.2.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.input_blocks.7.1.transformer_blocks.2.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.3.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.3.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.3.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.3.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.3.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.3.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.3.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.3.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.3.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.input_blocks.7.1.transformer_blocks.3.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.4.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.4.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.4.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.4.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.4.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.4.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.4.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.4.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.4.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.input_blocks.7.1.transformer_blocks.4.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.5.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.5.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.5.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.5.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.5.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.5.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.5.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.5.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.5.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.input_blocks.7.1.transformer_blocks.5.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.6.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.6.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.6.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.6.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.6.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.6.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.6.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.6.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.6.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.input_blocks.7.1.transformer_blocks.6.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.7.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.7.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.7.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.7.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.7.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.7.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.7.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.7.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.7.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.input_blocks.7.1.transformer_blocks.7.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.8.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.8.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.8.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.8.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.8.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.8.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.8.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.8.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.8.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.input_blocks.7.1.transformer_blocks.8.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.9.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.9.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.9.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.9.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.9.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.9.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.9.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.9.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.9.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.input_blocks.7.1.transformer_blocks.9.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.input_blocks.8.1.proj_in.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.proj_out.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.0.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.0.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.0.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.0.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.0.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.0.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.0.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.0.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.0.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.input_blocks.8.1.transformer_blocks.0.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.1.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.1.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.1.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.1.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.1.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.1.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.1.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.1.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.1.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.input_blocks.8.1.transformer_blocks.1.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.2.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.2.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.2.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.2.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.2.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.2.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.2.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.2.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.2.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.input_blocks.8.1.transformer_blocks.2.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.3.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.3.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.3.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.3.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.3.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.3.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.3.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.3.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.3.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.input_blocks.8.1.transformer_blocks.3.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.4.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.4.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.4.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.4.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.4.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.4.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.4.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.4.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.4.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.input_blocks.8.1.transformer_blocks.4.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.5.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.5.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.5.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.5.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.5.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.5.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.5.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.5.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.5.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.input_blocks.8.1.transformer_blocks.5.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.6.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.6.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.6.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.6.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.6.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.6.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.6.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.6.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.6.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.input_blocks.8.1.transformer_blocks.6.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.7.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.7.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.7.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.7.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.7.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.7.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.7.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.7.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.7.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.input_blocks.8.1.transformer_blocks.7.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.8.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.8.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.8.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.8.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.8.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.8.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.8.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.8.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.8.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.input_blocks.8.1.transformer_blocks.8.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.9.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.9.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.9.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.9.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.9.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.9.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.9.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.9.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.9.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.input_blocks.8.1.transformer_blocks.9.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.middle_block.1.proj_in.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.proj_out.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.0.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.0.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.0.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.0.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.0.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.0.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.0.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.0.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.0.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.middle_block.1.transformer_blocks.0.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.1.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.1.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.1.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.1.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.1.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.1.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.1.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.1.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.1.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.middle_block.1.transformer_blocks.1.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.2.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.2.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.2.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.2.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.2.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.2.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.2.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.2.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.2.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.middle_block.1.transformer_blocks.2.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.3.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.3.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.3.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.3.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.3.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.3.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.3.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.3.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.3.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.middle_block.1.transformer_blocks.3.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.4.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.4.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.4.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.4.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.4.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.4.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.4.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.4.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.4.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.middle_block.1.transformer_blocks.4.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.5.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.5.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.5.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.5.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.5.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.5.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.5.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.5.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.5.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.middle_block.1.transformer_blocks.5.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.6.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.6.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.6.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.6.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.6.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.6.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.6.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.6.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.6.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.middle_block.1.transformer_blocks.6.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.7.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.7.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.7.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.7.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.7.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.7.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.7.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.7.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.7.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.middle_block.1.transformer_blocks.7.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.8.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.8.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.8.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.8.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.8.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.8.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.8.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.8.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.8.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.middle_block.1.transformer_blocks.8.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.9.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.9.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.9.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.9.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.9.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.9.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.9.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.9.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.9.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.middle_block.1.transformer_blocks.9.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.0.1.proj_in.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.proj_out.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.0.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.0.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.0.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.0.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.0.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.0.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.0.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.0.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.0.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.output_blocks.0.1.transformer_blocks.0.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.1.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.1.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.1.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.1.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.1.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.1.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.1.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.1.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.1.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.output_blocks.0.1.transformer_blocks.1.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.2.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.2.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.2.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.2.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.2.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.2.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.2.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.2.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.2.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.output_blocks.0.1.transformer_blocks.2.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.3.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.3.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.3.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.3.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.3.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.3.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.3.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.3.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.3.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.output_blocks.0.1.transformer_blocks.3.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.4.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.4.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.4.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.4.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.4.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.4.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.4.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.4.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.4.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.output_blocks.0.1.transformer_blocks.4.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.5.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.5.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.5.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.5.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.5.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.5.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.5.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.5.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.5.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.output_blocks.0.1.transformer_blocks.5.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.6.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.6.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.6.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.6.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.6.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.6.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.6.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.6.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.6.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.output_blocks.0.1.transformer_blocks.6.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.7.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.7.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.7.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.7.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.7.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.7.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.7.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.7.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.7.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.output_blocks.0.1.transformer_blocks.7.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.8.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.8.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.8.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.8.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.8.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.8.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.8.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.8.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.8.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.output_blocks.0.1.transformer_blocks.8.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.9.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.9.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.9.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.9.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.9.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.9.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.9.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.9.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.9.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.output_blocks.0.1.transformer_blocks.9.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.1.1.proj_in.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.proj_out.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.0.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.0.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.0.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.0.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.0.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.0.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.0.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.0.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.0.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.output_blocks.1.1.transformer_blocks.0.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.1.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.1.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.1.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.1.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.1.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.1.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.1.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.1.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.1.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.output_blocks.1.1.transformer_blocks.1.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.2.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.2.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.2.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.2.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.2.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.2.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.2.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.2.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.2.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.output_blocks.1.1.transformer_blocks.2.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.3.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.3.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.3.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.3.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.3.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.3.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.3.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.3.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.3.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.output_blocks.1.1.transformer_blocks.3.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.4.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.4.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.4.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.4.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.4.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.4.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.4.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.4.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.4.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.output_blocks.1.1.transformer_blocks.4.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.5.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.5.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.5.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.5.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.5.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.5.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.5.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.5.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.5.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.output_blocks.1.1.transformer_blocks.5.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.6.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.6.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.6.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.6.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.6.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.6.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.6.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.6.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.6.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.output_blocks.1.1.transformer_blocks.6.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.7.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.7.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.7.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.7.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.7.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.7.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.7.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.7.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.7.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.output_blocks.1.1.transformer_blocks.7.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.8.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.8.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.8.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.8.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.8.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.8.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.8.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.8.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.8.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.output_blocks.1.1.transformer_blocks.8.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.9.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.9.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.9.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.9.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.9.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.9.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.9.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.9.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.9.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.output_blocks.1.1.transformer_blocks.9.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.2.1.proj_in.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.proj_out.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.0.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.0.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.0.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.0.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.0.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.0.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.0.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.0.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.0.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.output_blocks.2.1.transformer_blocks.0.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.1.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.1.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.1.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.1.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.1.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.1.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.1.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.1.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.1.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.output_blocks.2.1.transformer_blocks.1.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.2.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.2.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.2.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.2.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.2.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.2.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.2.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.2.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.2.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.output_blocks.2.1.transformer_blocks.2.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.3.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.3.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.3.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.3.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.3.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.3.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.3.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.3.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.3.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.output_blocks.2.1.transformer_blocks.3.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.4.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.4.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.4.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.4.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.4.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.4.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.4.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.4.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.4.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.output_blocks.2.1.transformer_blocks.4.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.5.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.5.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.5.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.5.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.5.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.5.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.5.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.5.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.5.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.output_blocks.2.1.transformer_blocks.5.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.6.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.6.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.6.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.6.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.6.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.6.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.6.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.6.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.6.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.output_blocks.2.1.transformer_blocks.6.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.7.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.7.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.7.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.7.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.7.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.7.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.7.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.7.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.7.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.output_blocks.2.1.transformer_blocks.7.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.8.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.8.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.8.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.8.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.8.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.8.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.8.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.8.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.8.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.output_blocks.2.1.transformer_blocks.8.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.9.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.9.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.9.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.9.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.9.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.9.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.9.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.9.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.9.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.output_blocks.2.1.transformer_blocks.9.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.3.1.proj_in.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.3.1.proj_out.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.3.1.transformer_blocks.0.attn1.to_k.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.3.1.transformer_blocks.0.attn1.to_out.0.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.3.1.transformer_blocks.0.attn1.to_q.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.3.1.transformer_blocks.0.attn1.to_v.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.3.1.transformer_blocks.0.attn2.to_k.weight shape=[640, 2048] input_dim=2048 output_dim=640
model.diffusion_model.output_blocks.3.1.transformer_blocks.0.attn2.to_out.0.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.3.1.transformer_blocks.0.attn2.to_q.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.3.1.transformer_blocks.0.attn2.to_v.weight shape=[640, 2048] input_dim=2048 output_dim=640
model.diffusion_model.output_blocks.3.1.transformer_blocks.0.ff.net.0.proj.weight shape=[5120, 640] input_dim=640 output_dim=5120
model.diffusion_model.output_blocks.3.1.transformer_blocks.0.ff.net.2.weight shape=[640, 2560] input_dim=2560 output_dim=640
model.diffusion_model.output_blocks.3.1.transformer_blocks.1.attn1.to_k.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.3.1.transformer_blocks.1.attn1.to_out.0.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.3.1.transformer_blocks.1.attn1.to_q.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.3.1.transformer_blocks.1.attn1.to_v.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.3.1.transformer_blocks.1.attn2.to_k.weight shape=[640, 2048] input_dim=2048 output_dim=640
model.diffusion_model.output_blocks.3.1.transformer_blocks.1.attn2.to_out.0.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.3.1.transformer_blocks.1.attn2.to_q.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.3.1.transformer_blocks.1.attn2.to_v.weight shape=[640, 2048] input_dim=2048 output_dim=640
model.diffusion_model.output_blocks.3.1.transformer_blocks.1.ff.net.0.proj.weight shape=[5120, 640] input_dim=640 output_dim=5120
model.diffusion_model.output_blocks.3.1.transformer_blocks.1.ff.net.2.weight shape=[640, 2560] input_dim=2560 output_dim=640
model.diffusion_model.output_blocks.4.1.proj_in.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.4.1.proj_out.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.4.1.transformer_blocks.0.attn1.to_k.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.4.1.transformer_blocks.0.attn1.to_out.0.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.4.1.transformer_blocks.0.attn1.to_q.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.4.1.transformer_blocks.0.attn1.to_v.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.4.1.transformer_blocks.0.attn2.to_k.weight shape=[640, 2048] input_dim=2048 output_dim=640
model.diffusion_model.output_blocks.4.1.transformer_blocks.0.attn2.to_out.0.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.4.1.transformer_blocks.0.attn2.to_q.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.4.1.transformer_blocks.0.attn2.to_v.weight shape=[640, 2048] input_dim=2048 output_dim=640
model.diffusion_model.output_blocks.4.1.transformer_blocks.0.ff.net.0.proj.weight shape=[5120, 640] input_dim=640 output_dim=5120
model.diffusion_model.output_blocks.4.1.transformer_blocks.0.ff.net.2.weight shape=[640, 2560] input_dim=2560 output_dim=640
model.diffusion_model.output_blocks.4.1.transformer_blocks.1.attn1.to_k.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.4.1.transformer_blocks.1.attn1.to_out.0.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.4.1.transformer_blocks.1.attn1.to_q.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.4.1.transformer_blocks.1.attn1.to_v.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.4.1.transformer_blocks.1.attn2.to_k.weight shape=[640, 2048] input_dim=2048 output_dim=640
model.diffusion_model.output_blocks.4.1.transformer_blocks.1.attn2.to_out.0.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.4.1.transformer_blocks.1.attn2.to_q.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.4.1.transformer_blocks.1.attn2.to_v.weight shape=[640, 2048] input_dim=2048 output_dim=640
model.diffusion_model.output_blocks.4.1.transformer_blocks.1.ff.net.0.proj.weight shape=[5120, 640] input_dim=640 output_dim=5120
model.diffusion_model.output_blocks.4.1.transformer_blocks.1.ff.net.2.weight shape=[640, 2560] input_dim=2560 output_dim=640
model.diffusion_model.output_blocks.5.1.proj_in.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.5.1.proj_out.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.5.1.transformer_blocks.0.attn1.to_k.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.5.1.transformer_blocks.0.attn1.to_out.0.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.5.1.transformer_blocks.0.attn1.to_q.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.5.1.transformer_blocks.0.attn1.to_v.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.5.1.transformer_blocks.0.attn2.to_k.weight shape=[640, 2048] input_dim=2048 output_dim=640
model.diffusion_model.output_blocks.5.1.transformer_blocks.0.attn2.to_out.0.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.5.1.transformer_blocks.0.attn2.to_q.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.5.1.transformer_blocks.0.attn2.to_v.weight shape=[640, 2048] input_dim=2048 output_dim=640
model.diffusion_model.output_blocks.5.1.transformer_blocks.0.ff.net.0.proj.weight shape=[5120, 640] input_dim=640 output_dim=5120
model.diffusion_model.output_blocks.5.1.transformer_blocks.0.ff.net.2.weight shape=[640, 2560] input_dim=2560 output_dim=640
model.diffusion_model.output_blocks.5.1.transformer_blocks.1.attn1.to_k.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.5.1.transformer_blocks.1.attn1.to_out.0.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.5.1.transformer_blocks.1.attn1.to_q.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.5.1.transformer_blocks.1.attn1.to_v.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.5.1.transformer_blocks.1.attn2.to_k.weight shape=[640, 2048] input_dim=2048 output_dim=640
model.diffusion_model.output_blocks.5.1.transformer_blocks.1.attn2.to_out.0.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.5.1.transformer_blocks.1.attn2.to_q.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.5.1.transformer_blocks.1.attn2.to_v.weight shape=[640, 2048] input_dim=2048 output_dim=640
model.diffusion_model.output_blocks.5.1.transformer_blocks.1.ff.net.0.proj.weight shape=[5120, 640] input_dim=640 output_dim=5120
model.diffusion_model.output_blocks.5.1.transformer_blocks.1.ff.net.2.weight shape=[640, 2560] input_dim=2560 output_dim=640