OrbitQuant SDXL UNet-only custom export W2A4
========================================================================================================================
Source: /content/creaprompt_sdxl/creapromptLightning_creapromtHypersdxlV1.safetensors
Output: /content/creaprompt_sdxl/orbitquant_unet/creaprompt_UNet_OrbitQuant_W2A4_projio.safetensors
Output file size: 1,274,851,840 / 1.187 GiB

Original UNet
------------------------------------------------------------------------------------------------------------------------
UNet keys:   1,680
UNet params: 2,567,463,684
UNet FP16:   5,134,927,368 / 4.782 GiB

Targeted OrbitQuant weights
------------------------------------------------------------------------------------------------------------------------
Target keys:   722
Target params: 2,207,744,000
Target FP16:   4,415,488,000 / 4.112 GiB
Target share:  85.989298% of UNet params
Input dims:    [640, 1280, 2048, 2560, 5120]

Custom stored size estimate
------------------------------------------------------------------------------------------------------------------------
Untouched kept UNet bytes:       719,439,368 / 686.111 MiB
Packed quantized index bytes:    551,936,000 / 526.367 MiB
Row norm bytes:                  2,872,320 / 2.739 MiB
Estimate without metadata:       1,274,247,688 / 1.187 GiB
Actual safetensors file:         1,274,851,840 / 1.187 GiB
Saved from original UNet FP16:   3,860,075,528 / 3.595 GiB
UNet shrink vs FP16:             75.1729%

Quantized keys
------------------------------------------------------------------------------------------------------------------------
model.diffusion_model.input_blocks.4.1.proj_in.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.input_blocks.4.1.proj_out.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.input_blocks.4.1.transformer_blocks.0.attn1.to_k.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.input_blocks.4.1.transformer_blocks.0.attn1.to_out.0.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.input_blocks.4.1.transformer_blocks.0.attn1.to_q.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.input_blocks.4.1.transformer_blocks.0.attn1.to_v.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.input_blocks.4.1.transformer_blocks.0.attn2.to_k.weight shape=[640, 2048] input_dim=2048 output_dim=640
model.diffusion_model.input_blocks.4.1.transformer_blocks.0.attn2.to_out.0.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.input_blocks.4.1.transformer_blocks.0.attn2.to_q.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.input_blocks.4.1.transformer_blocks.0.attn2.to_v.weight shape=[640, 2048] input_dim=2048 output_dim=640
model.diffusion_model.input_blocks.4.1.transformer_blocks.0.ff.net.0.proj.weight shape=[5120, 640] input_dim=640 output_dim=5120
model.diffusion_model.input_blocks.4.1.transformer_blocks.0.ff.net.2.weight shape=[640, 2560] input_dim=2560 output_dim=640
model.diffusion_model.input_blocks.4.1.transformer_blocks.1.attn1.to_k.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.input_blocks.4.1.transformer_blocks.1.attn1.to_out.0.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.input_blocks.4.1.transformer_blocks.1.attn1.to_q.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.input_blocks.4.1.transformer_blocks.1.attn1.to_v.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.input_blocks.4.1.transformer_blocks.1.attn2.to_k.weight shape=[640, 2048] input_dim=2048 output_dim=640
model.diffusion_model.input_blocks.4.1.transformer_blocks.1.attn2.to_out.0.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.input_blocks.4.1.transformer_blocks.1.attn2.to_q.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.input_blocks.4.1.transformer_blocks.1.attn2.to_v.weight shape=[640, 2048] input_dim=2048 output_dim=640
model.diffusion_model.input_blocks.4.1.transformer_blocks.1.ff.net.0.proj.weight shape=[5120, 640] input_dim=640 output_dim=5120
model.diffusion_model.input_blocks.4.1.transformer_blocks.1.ff.net.2.weight shape=[640, 2560] input_dim=2560 output_dim=640
model.diffusion_model.input_blocks.5.1.proj_in.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.input_blocks.5.1.proj_out.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.input_blocks.5.1.transformer_blocks.0.attn1.to_k.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.input_blocks.5.1.transformer_blocks.0.attn1.to_out.0.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.input_blocks.5.1.transformer_blocks.0.attn1.to_q.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.input_blocks.5.1.transformer_blocks.0.attn1.to_v.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.input_blocks.5.1.transformer_blocks.0.attn2.to_k.weight shape=[640, 2048] input_dim=2048 output_dim=640
model.diffusion_model.input_blocks.5.1.transformer_blocks.0.attn2.to_out.0.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.input_blocks.5.1.transformer_blocks.0.attn2.to_q.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.input_blocks.5.1.transformer_blocks.0.attn2.to_v.weight shape=[640, 2048] input_dim=2048 output_dim=640
model.diffusion_model.input_blocks.5.1.transformer_blocks.0.ff.net.0.proj.weight shape=[5120, 640] input_dim=640 output_dim=5120
model.diffusion_model.input_blocks.5.1.transformer_blocks.0.ff.net.2.weight shape=[640, 2560] input_dim=2560 output_dim=640
model.diffusion_model.input_blocks.5.1.transformer_blocks.1.attn1.to_k.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.input_blocks.5.1.transformer_blocks.1.attn1.to_out.0.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.input_blocks.5.1.transformer_blocks.1.attn1.to_q.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.input_blocks.5.1.transformer_blocks.1.attn1.to_v.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.input_blocks.5.1.transformer_blocks.1.attn2.to_k.weight shape=[640, 2048] input_dim=2048 output_dim=640
model.diffusion_model.input_blocks.5.1.transformer_blocks.1.attn2.to_out.0.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.input_blocks.5.1.transformer_blocks.1.attn2.to_q.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.input_blocks.5.1.transformer_blocks.1.attn2.to_v.weight shape=[640, 2048] input_dim=2048 output_dim=640
model.diffusion_model.input_blocks.5.1.transformer_blocks.1.ff.net.0.proj.weight shape=[5120, 640] input_dim=640 output_dim=5120
model.diffusion_model.input_blocks.5.1.transformer_blocks.1.ff.net.2.weight shape=[640, 2560] input_dim=2560 output_dim=640
model.diffusion_model.input_blocks.7.1.proj_in.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.proj_out.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.0.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.0.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.0.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.0.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.0.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.0.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.0.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.0.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.0.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.input_blocks.7.1.transformer_blocks.0.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.1.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.1.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.1.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.1.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.1.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.1.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.1.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.1.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.1.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.input_blocks.7.1.transformer_blocks.1.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.2.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.2.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.2.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.2.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.2.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.2.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.2.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.2.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.2.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.input_blocks.7.1.transformer_blocks.2.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.3.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.3.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.3.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.3.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.3.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.3.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.3.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.3.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.3.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.input_blocks.7.1.transformer_blocks.3.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.4.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.4.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.4.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.4.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.4.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.4.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.4.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.4.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.4.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.input_blocks.7.1.transformer_blocks.4.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.5.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.5.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.5.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.5.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.5.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.5.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.5.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.5.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.5.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.input_blocks.7.1.transformer_blocks.5.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.6.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.6.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.6.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.6.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.6.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.6.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.6.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.6.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.6.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.input_blocks.7.1.transformer_blocks.6.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.7.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.7.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.7.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.7.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.7.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.7.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.7.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.7.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.7.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.input_blocks.7.1.transformer_blocks.7.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.8.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.8.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.8.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.8.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.8.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.8.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.8.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.8.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.8.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.input_blocks.7.1.transformer_blocks.8.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.9.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.9.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.9.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.9.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.9.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.9.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.9.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.9.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.7.1.transformer_blocks.9.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.input_blocks.7.1.transformer_blocks.9.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.input_blocks.8.1.proj_in.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.proj_out.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.0.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.0.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.0.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.0.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.0.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.0.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.0.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.0.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.0.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.input_blocks.8.1.transformer_blocks.0.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.1.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.1.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.1.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.1.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.1.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.1.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.1.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.1.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.1.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.input_blocks.8.1.transformer_blocks.1.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.2.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.2.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.2.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.2.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.2.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.2.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.2.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.2.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.2.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.input_blocks.8.1.transformer_blocks.2.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.3.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.3.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.3.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.3.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.3.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.3.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.3.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.3.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.3.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.input_blocks.8.1.transformer_blocks.3.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.4.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.4.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.4.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.4.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.4.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.4.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.4.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.4.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.4.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.input_blocks.8.1.transformer_blocks.4.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.5.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.5.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.5.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.5.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.5.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.5.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.5.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.5.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.5.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.input_blocks.8.1.transformer_blocks.5.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.6.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.6.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.6.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.6.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.6.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.6.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.6.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.6.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.6.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.input_blocks.8.1.transformer_blocks.6.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.7.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.7.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.7.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.7.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.7.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.7.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.7.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.7.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.7.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.input_blocks.8.1.transformer_blocks.7.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.8.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.8.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.8.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.8.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.8.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.8.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.8.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.8.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.8.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.input_blocks.8.1.transformer_blocks.8.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.9.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.9.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.9.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.9.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.9.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.9.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.9.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.9.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.input_blocks.8.1.transformer_blocks.9.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.input_blocks.8.1.transformer_blocks.9.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.middle_block.1.proj_in.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.proj_out.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.0.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.0.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.0.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.0.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.0.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.0.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.0.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.0.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.0.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.middle_block.1.transformer_blocks.0.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.1.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.1.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.1.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.1.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.1.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.1.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.1.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.1.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.1.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.middle_block.1.transformer_blocks.1.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.2.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.2.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.2.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.2.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.2.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.2.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.2.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.2.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.2.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.middle_block.1.transformer_blocks.2.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.3.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.3.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.3.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.3.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.3.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.3.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.3.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.3.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.3.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.middle_block.1.transformer_blocks.3.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.4.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.4.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.4.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.4.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.4.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.4.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.4.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.4.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.4.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.middle_block.1.transformer_blocks.4.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.5.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.5.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.5.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.5.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.5.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.5.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.5.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.5.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.5.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.middle_block.1.transformer_blocks.5.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.6.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.6.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.6.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.6.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.6.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.6.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.6.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.6.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.6.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.middle_block.1.transformer_blocks.6.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.7.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.7.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.7.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.7.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.7.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.7.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.7.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.7.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.7.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.middle_block.1.transformer_blocks.7.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.8.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.8.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.8.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.8.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.8.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.8.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.8.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.8.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.8.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.middle_block.1.transformer_blocks.8.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.9.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.9.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.9.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.9.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.9.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.9.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.9.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.9.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.middle_block.1.transformer_blocks.9.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.middle_block.1.transformer_blocks.9.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.0.1.proj_in.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.proj_out.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.0.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.0.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.0.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.0.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.0.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.0.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.0.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.0.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.0.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.output_blocks.0.1.transformer_blocks.0.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.1.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.1.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.1.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.1.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.1.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.1.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.1.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.1.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.1.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.output_blocks.0.1.transformer_blocks.1.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.2.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.2.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.2.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.2.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.2.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.2.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.2.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.2.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.2.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.output_blocks.0.1.transformer_blocks.2.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.3.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.3.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.3.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.3.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.3.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.3.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.3.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.3.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.3.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.output_blocks.0.1.transformer_blocks.3.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.4.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.4.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.4.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.4.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.4.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.4.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.4.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.4.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.4.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.output_blocks.0.1.transformer_blocks.4.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.5.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.5.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.5.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.5.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.5.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.5.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.5.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.5.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.5.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.output_blocks.0.1.transformer_blocks.5.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.6.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.6.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.6.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.6.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.6.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.6.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.6.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.6.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.6.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.output_blocks.0.1.transformer_blocks.6.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.7.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.7.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.7.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.7.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.7.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.7.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.7.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.7.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.7.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.output_blocks.0.1.transformer_blocks.7.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.8.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.8.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.8.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.8.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.8.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.8.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.8.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.8.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.8.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.output_blocks.0.1.transformer_blocks.8.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.9.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.9.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.9.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.9.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.9.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.9.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.9.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.9.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.0.1.transformer_blocks.9.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.output_blocks.0.1.transformer_blocks.9.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.1.1.proj_in.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.proj_out.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.0.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.0.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.0.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.0.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.0.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.0.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.0.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.0.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.0.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.output_blocks.1.1.transformer_blocks.0.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.1.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.1.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.1.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.1.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.1.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.1.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.1.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.1.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.1.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.output_blocks.1.1.transformer_blocks.1.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.2.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.2.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.2.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.2.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.2.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.2.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.2.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.2.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.2.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.output_blocks.1.1.transformer_blocks.2.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.3.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.3.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.3.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.3.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.3.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.3.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.3.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.3.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.3.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.output_blocks.1.1.transformer_blocks.3.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.4.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.4.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.4.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.4.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.4.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.4.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.4.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.4.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.4.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.output_blocks.1.1.transformer_blocks.4.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.5.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.5.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.5.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.5.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.5.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.5.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.5.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.5.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.5.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.output_blocks.1.1.transformer_blocks.5.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.6.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.6.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.6.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.6.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.6.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.6.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.6.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.6.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.6.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.output_blocks.1.1.transformer_blocks.6.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.7.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.7.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.7.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.7.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.7.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.7.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.7.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.7.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.7.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.output_blocks.1.1.transformer_blocks.7.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.8.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.8.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.8.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.8.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.8.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.8.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.8.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.8.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.8.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.output_blocks.1.1.transformer_blocks.8.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.9.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.9.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.9.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.9.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.9.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.9.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.9.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.9.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.1.1.transformer_blocks.9.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.output_blocks.1.1.transformer_blocks.9.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.2.1.proj_in.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.proj_out.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.0.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.0.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.0.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.0.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.0.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.0.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.0.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.0.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.0.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.output_blocks.2.1.transformer_blocks.0.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.1.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.1.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.1.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.1.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.1.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.1.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.1.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.1.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.1.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.output_blocks.2.1.transformer_blocks.1.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.2.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.2.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.2.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.2.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.2.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.2.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.2.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.2.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.2.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.output_blocks.2.1.transformer_blocks.2.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.3.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.3.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.3.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.3.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.3.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.3.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.3.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.3.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.3.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.output_blocks.2.1.transformer_blocks.3.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.4.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.4.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.4.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.4.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.4.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.4.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.4.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.4.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.4.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.output_blocks.2.1.transformer_blocks.4.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.5.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.5.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.5.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.5.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.5.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.5.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.5.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.5.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.5.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.output_blocks.2.1.transformer_blocks.5.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.6.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.6.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.6.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.6.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.6.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.6.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.6.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.6.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.6.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.output_blocks.2.1.transformer_blocks.6.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.7.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.7.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.7.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.7.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.7.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.7.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.7.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.7.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.7.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.output_blocks.2.1.transformer_blocks.7.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.8.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.8.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.8.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.8.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.8.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.8.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.8.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.8.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.8.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.output_blocks.2.1.transformer_blocks.8.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.9.attn1.to_k.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.9.attn1.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.9.attn1.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.9.attn1.to_v.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.9.attn2.to_k.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.9.attn2.to_out.0.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.9.attn2.to_q.weight shape=[1280, 1280] input_dim=1280 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.9.attn2.to_v.weight shape=[1280, 2048] input_dim=2048 output_dim=1280
model.diffusion_model.output_blocks.2.1.transformer_blocks.9.ff.net.0.proj.weight shape=[10240, 1280] input_dim=1280 output_dim=10240
model.diffusion_model.output_blocks.2.1.transformer_blocks.9.ff.net.2.weight shape=[1280, 5120] input_dim=5120 output_dim=1280
model.diffusion_model.output_blocks.3.1.proj_in.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.3.1.proj_out.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.3.1.transformer_blocks.0.attn1.to_k.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.3.1.transformer_blocks.0.attn1.to_out.0.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.3.1.transformer_blocks.0.attn1.to_q.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.3.1.transformer_blocks.0.attn1.to_v.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.3.1.transformer_blocks.0.attn2.to_k.weight shape=[640, 2048] input_dim=2048 output_dim=640
model.diffusion_model.output_blocks.3.1.transformer_blocks.0.attn2.to_out.0.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.3.1.transformer_blocks.0.attn2.to_q.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.3.1.transformer_blocks.0.attn2.to_v.weight shape=[640, 2048] input_dim=2048 output_dim=640
model.diffusion_model.output_blocks.3.1.transformer_blocks.0.ff.net.0.proj.weight shape=[5120, 640] input_dim=640 output_dim=5120
model.diffusion_model.output_blocks.3.1.transformer_blocks.0.ff.net.2.weight shape=[640, 2560] input_dim=2560 output_dim=640
model.diffusion_model.output_blocks.3.1.transformer_blocks.1.attn1.to_k.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.3.1.transformer_blocks.1.attn1.to_out.0.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.3.1.transformer_blocks.1.attn1.to_q.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.3.1.transformer_blocks.1.attn1.to_v.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.3.1.transformer_blocks.1.attn2.to_k.weight shape=[640, 2048] input_dim=2048 output_dim=640
model.diffusion_model.output_blocks.3.1.transformer_blocks.1.attn2.to_out.0.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.3.1.transformer_blocks.1.attn2.to_q.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.3.1.transformer_blocks.1.attn2.to_v.weight shape=[640, 2048] input_dim=2048 output_dim=640
model.diffusion_model.output_blocks.3.1.transformer_blocks.1.ff.net.0.proj.weight shape=[5120, 640] input_dim=640 output_dim=5120
model.diffusion_model.output_blocks.3.1.transformer_blocks.1.ff.net.2.weight shape=[640, 2560] input_dim=2560 output_dim=640
model.diffusion_model.output_blocks.4.1.proj_in.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.4.1.proj_out.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.4.1.transformer_blocks.0.attn1.to_k.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.4.1.transformer_blocks.0.attn1.to_out.0.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.4.1.transformer_blocks.0.attn1.to_q.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.4.1.transformer_blocks.0.attn1.to_v.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.4.1.transformer_blocks.0.attn2.to_k.weight shape=[640, 2048] input_dim=2048 output_dim=640
model.diffusion_model.output_blocks.4.1.transformer_blocks.0.attn2.to_out.0.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.4.1.transformer_blocks.0.attn2.to_q.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.4.1.transformer_blocks.0.attn2.to_v.weight shape=[640, 2048] input_dim=2048 output_dim=640
model.diffusion_model.output_blocks.4.1.transformer_blocks.0.ff.net.0.proj.weight shape=[5120, 640] input_dim=640 output_dim=5120
model.diffusion_model.output_blocks.4.1.transformer_blocks.0.ff.net.2.weight shape=[640, 2560] input_dim=2560 output_dim=640
model.diffusion_model.output_blocks.4.1.transformer_blocks.1.attn1.to_k.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.4.1.transformer_blocks.1.attn1.to_out.0.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.4.1.transformer_blocks.1.attn1.to_q.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.4.1.transformer_blocks.1.attn1.to_v.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.4.1.transformer_blocks.1.attn2.to_k.weight shape=[640, 2048] input_dim=2048 output_dim=640
model.diffusion_model.output_blocks.4.1.transformer_blocks.1.attn2.to_out.0.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.4.1.transformer_blocks.1.attn2.to_q.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.4.1.transformer_blocks.1.attn2.to_v.weight shape=[640, 2048] input_dim=2048 output_dim=640
model.diffusion_model.output_blocks.4.1.transformer_blocks.1.ff.net.0.proj.weight shape=[5120, 640] input_dim=640 output_dim=5120
model.diffusion_model.output_blocks.4.1.transformer_blocks.1.ff.net.2.weight shape=[640, 2560] input_dim=2560 output_dim=640
model.diffusion_model.output_blocks.5.1.proj_in.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.5.1.proj_out.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.5.1.transformer_blocks.0.attn1.to_k.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.5.1.transformer_blocks.0.attn1.to_out.0.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.5.1.transformer_blocks.0.attn1.to_q.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.5.1.transformer_blocks.0.attn1.to_v.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.5.1.transformer_blocks.0.attn2.to_k.weight shape=[640, 2048] input_dim=2048 output_dim=640
model.diffusion_model.output_blocks.5.1.transformer_blocks.0.attn2.to_out.0.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.5.1.transformer_blocks.0.attn2.to_q.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.5.1.transformer_blocks.0.attn2.to_v.weight shape=[640, 2048] input_dim=2048 output_dim=640
model.diffusion_model.output_blocks.5.1.transformer_blocks.0.ff.net.0.proj.weight shape=[5120, 640] input_dim=640 output_dim=5120
model.diffusion_model.output_blocks.5.1.transformer_blocks.0.ff.net.2.weight shape=[640, 2560] input_dim=2560 output_dim=640
model.diffusion_model.output_blocks.5.1.transformer_blocks.1.attn1.to_k.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.5.1.transformer_blocks.1.attn1.to_out.0.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.5.1.transformer_blocks.1.attn1.to_q.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.5.1.transformer_blocks.1.attn1.to_v.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.5.1.transformer_blocks.1.attn2.to_k.weight shape=[640, 2048] input_dim=2048 output_dim=640
model.diffusion_model.output_blocks.5.1.transformer_blocks.1.attn2.to_out.0.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.5.1.transformer_blocks.1.attn2.to_q.weight shape=[640, 640] input_dim=640 output_dim=640
model.diffusion_model.output_blocks.5.1.transformer_blocks.1.attn2.to_v.weight shape=[640, 2048] input_dim=2048 output_dim=640
model.diffusion_model.output_blocks.5.1.transformer_blocks.1.ff.net.0.proj.weight shape=[5120, 640] input_dim=640 output_dim=5120
model.diffusion_model.output_blocks.5.1.transformer_blocks.1.ff.net.2.weight shape=[640, 2560] input_dim=2560 output_dim=640