Hugging Face's logo

tonera
/
Chroma1-HD-SVDQ

Text-to-Image
Diffusers
Safetensors
ChromaPipeline
Chroma
quantization
svdquant
nunchaku
fp4
int4
Model card Files
xet
 Community
4
tonera commited on
Commit
ee3dc2c
·
verified ·
1 Parent(s): 8dbdd8a

Add files using upload-large-folder tool

Browse files
Files changed (27) hide show
  1. .gitattributes +3 -0
  2. .msc +0 -0
  3. .mv +1 -0
  4. ComfyUI_Chroma1-HD_T2I-overview.png +3 -0
  5. ComfyUI_Chroma1-HD_T2I-sample.png +3 -0
  6. ComfyUI_Chroma1-HD_T2I-workflow.json +1025 -0
  7. README.md +181 -0
  8. configuration.json +1 -0
  9. images/FictionalChromaBanner_1.png +3 -0
  10. model_index.json +32 -0
  11. scheduler/scheduler_config.json +18 -0
  12. svdq-fp4_r32-Chroma1-HD.safetensors +3 -0
  13. svdq-int4_r32-Chroma1-HD.safetensors +3 -0
  14. text_encoder/config.json +31 -0
  15. text_encoder/model-00001-of-00002.safetensors +3 -0
  16. text_encoder/model-00002-of-00002.safetensors +3 -0
  17. text_encoder/model.safetensors.index.json +227 -0
  18. tokenizer/added_tokens.json +102 -0
  19. tokenizer/special_tokens_map.json +125 -0
  20. tokenizer/spiece.model +3 -0
  21. tokenizer/tokenizer_config.json +941 -0
  22. transformer/config.json +22 -0
  23. transformer/diffusion_pytorch_model-00001-of-00002.safetensors +3 -0
  24. transformer/diffusion_pytorch_model-00002-of-00002.safetensors +3 -0
  25. transformer/diffusion_pytorch_model.safetensors.index.json +0 -0
  26. vae/config.json +38 -0
  27. vae/diffusion_pytorch_model.safetensors +3 -0
.gitattributes CHANGED
@@ -33,3 +33,6 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ ComfyUI_Chroma1-HD_T2I-overview.png filter=lfs diff=lfs merge=lfs -text
37
+ ComfyUI_Chroma1-HD_T2I-sample.png filter=lfs diff=lfs merge=lfs -text
38
+ images/FictionalChromaBanner_1.png filter=lfs diff=lfs merge=lfs -text
.msc ADDED
Binary file (1.96 kB). View file
 
.mv ADDED
@@ -0,0 +1 @@
 
 
1
+ Revision:master,CreatedAt:1761253436
ComfyUI_Chroma1-HD_T2I-overview.png ADDED

Git LFS Details

  • SHA256: 7fb919582e144e1f4da05aa059692f477adfec71cf0baa8814d291afc1955c7b
  • Pointer size: 132 Bytes
  • Size of remote file: 4.1 MB
ComfyUI_Chroma1-HD_T2I-sample.png ADDED

Git LFS Details

  • SHA256: f11297baafd5b98723fa0bc16b35a5283bcf8fe9ee5212338649d59f620972a3
  • Pointer size: 132 Bytes
  • Size of remote file: 1.85 MB
ComfyUI_Chroma1-HD_T2I-workflow.json ADDED
@@ -0,0 +1,1025 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "id": "b2d37916-fab5-425f-850d-7a64886e4d54",
3
+ "revision": 0,
4
+ "last_node_id": 752,
5
+ "last_link_id": 1376,
6
+ "nodes": [
7
+ {
8
+ "id": 298,
9
+ "type": "VAEDecode",
10
+ "pos": [
11
+ -1440,
12
+ 1544
13
+ ],
14
+ "size": [
15
+ 140,
16
+ 46
17
+ ],
18
+ "flags": {
19
+ "collapsed": false
20
+ },
21
+ "order": 16,
22
+ "mode": 0,
23
+ "inputs": [
24
+ {
25
+ "name": "samples",
26
+ "type": "LATENT",
27
+ "link": 1355
28
+ },
29
+ {
30
+ "name": "vae",
31
+ "type": "VAE",
32
+ "link": 1252
33
+ }
34
+ ],
35
+ "outputs": [
36
+ {
37
+ "name": "IMAGE",
38
+ "type": "IMAGE",
39
+ "links": [
40
+ 1341
41
+ ]
42
+ }
43
+ ],
44
+ "properties": {
45
+ "enableTabs": false,
46
+ "tabWidth": 65,
47
+ "tabXOffset": 10,
48
+ "hasSecondTab": false,
49
+ "secondTabText": "Send Back",
50
+ "secondTabOffset": 80,
51
+ "secondTabWidth": 65,
52
+ "cnr_id": "comfy-core",
53
+ "ver": "0.3.27",
54
+ "Node name for S&R": "VAEDecode"
55
+ },
56
+ "widgets_values": []
57
+ },
58
+ {
59
+ "id": 694,
60
+ "type": "CFGGuider",
61
+ "pos": [
62
+ -1760,
63
+ 1360
64
+ ],
65
+ "size": [
66
+ 210,
67
+ 98
68
+ ],
69
+ "flags": {
70
+ "collapsed": false
71
+ },
72
+ "order": 14,
73
+ "mode": 0,
74
+ "inputs": [
75
+ {
76
+ "name": "model",
77
+ "type": "MODEL",
78
+ "link": 1370
79
+ },
80
+ {
81
+ "name": "positive",
82
+ "type": "CONDITIONING",
83
+ "link": 1358
84
+ },
85
+ {
86
+ "name": "negative",
87
+ "type": "CONDITIONING",
88
+ "link": 1361
89
+ }
90
+ ],
91
+ "outputs": [
92
+ {
93
+ "name": "GUIDER",
94
+ "type": "GUIDER",
95
+ "links": [
96
+ 1351
97
+ ]
98
+ }
99
+ ],
100
+ "properties": {
101
+ "enableTabs": false,
102
+ "tabWidth": 65,
103
+ "tabXOffset": 10,
104
+ "hasSecondTab": false,
105
+ "secondTabText": "Send Back",
106
+ "secondTabOffset": 80,
107
+ "secondTabWidth": 65,
108
+ "cnr_id": "comfy-core",
109
+ "ver": "0.3.27",
110
+ "Node name for S&R": "CFGGuider"
111
+ },
112
+ "widgets_values": [
113
+ 3.8
114
+ ]
115
+ },
116
+ {
117
+ "id": 700,
118
+ "type": "KSamplerSelect",
119
+ "pos": [
120
+ -1760,
121
+ 1504
122
+ ],
123
+ "size": [
124
+ 210,
125
+ 58
126
+ ],
127
+ "flags": {
128
+ "collapsed": false
129
+ },
130
+ "order": 1,
131
+ "mode": 0,
132
+ "inputs": [],
133
+ "outputs": [
134
+ {
135
+ "name": "SAMPLER",
136
+ "type": "SAMPLER",
137
+ "links": [
138
+ 1352
139
+ ]
140
+ }
141
+ ],
142
+ "properties": {
143
+ "enableTabs": false,
144
+ "tabWidth": 65,
145
+ "tabXOffset": 10,
146
+ "hasSecondTab": false,
147
+ "secondTabText": "Send Back",
148
+ "secondTabOffset": 80,
149
+ "secondTabWidth": 65,
150
+ "cnr_id": "comfy-core",
151
+ "ver": "0.3.49",
152
+ "Node name for S&R": "KSamplerSelect"
153
+ },
154
+ "widgets_values": [
155
+ "euler"
156
+ ]
157
+ },
158
+ {
159
+ "id": 701,
160
+ "type": "ModelSamplingAuraFlow",
161
+ "pos": [
162
+ -1800,
163
+ 792
164
+ ],
165
+ "size": [
166
+ 210,
167
+ 58
168
+ ],
169
+ "flags": {
170
+ "collapsed": false
171
+ },
172
+ "order": 10,
173
+ "mode": 0,
174
+ "inputs": [
175
+ {
176
+ "name": "model",
177
+ "type": "MODEL",
178
+ "link": 1366
179
+ }
180
+ ],
181
+ "outputs": [
182
+ {
183
+ "name": "MODEL",
184
+ "type": "MODEL",
185
+ "links": [
186
+ 1370,
187
+ 1372
188
+ ]
189
+ }
190
+ ],
191
+ "title": "Flow Shift",
192
+ "properties": {
193
+ "enableTabs": false,
194
+ "tabWidth": 65,
195
+ "tabXOffset": 10,
196
+ "hasSecondTab": false,
197
+ "secondTabText": "Send Back",
198
+ "secondTabOffset": 80,
199
+ "secondTabWidth": 65,
200
+ "cnr_id": "comfy-core",
201
+ "ver": "0.3.52",
202
+ "Node name for S&R": "ModelSamplingAuraFlow"
203
+ },
204
+ "widgets_values": [
205
+ 1
206
+ ]
207
+ },
208
+ {
209
+ "id": 710,
210
+ "type": "VAELoader",
211
+ "pos": [
212
+ -2256,
213
+ 1016
214
+ ],
215
+ "size": [
216
+ 370,
217
+ 60
218
+ ],
219
+ "flags": {
220
+ "collapsed": false
221
+ },
222
+ "order": 0,
223
+ "mode": 0,
224
+ "inputs": [],
225
+ "outputs": [
226
+ {
227
+ "name": "VAE",
228
+ "type": "VAE",
229
+ "links": [
230
+ 1252
231
+ ]
232
+ }
233
+ ],
234
+ "properties": {
235
+ "enableTabs": false,
236
+ "tabWidth": 65,
237
+ "tabXOffset": 10,
238
+ "hasSecondTab": false,
239
+ "secondTabText": "Send Back",
240
+ "secondTabOffset": 80,
241
+ "secondTabWidth": 65,
242
+ "cnr_id": "comfy-core",
243
+ "ver": "0.3.27",
244
+ "Node name for S&R": "VAELoader",
245
+ "models": [
246
+ {
247
+ "name": "ae.safetensors",
248
+ "url": "https://huggingface.co/Comfy-Org/Lumina_Image_2.0_Repackaged/resolve/main/split_files/vae/ae.safetensors",
249
+ "directory": "vae"
250
+ }
251
+ ]
252
+ },
253
+ "widgets_values": [
254
+ "ae.safetensors"
255
+ ]
256
+ },
257
+ {
258
+ "id": 718,
259
+ "type": "RandomNoise",
260
+ "pos": [
261
+ -1760,
262
+ 1232
263
+ ],
264
+ "size": [
265
+ 210,
266
+ 82
267
+ ],
268
+ "flags": {},
269
+ "order": 4,
270
+ "mode": 0,
271
+ "inputs": [],
272
+ "outputs": [
273
+ {
274
+ "name": "NOISE",
275
+ "type": "NOISE",
276
+ "links": [
277
+ 1350
278
+ ]
279
+ }
280
+ ],
281
+ "title": "SEED",
282
+ "properties": {
283
+ "enableTabs": false,
284
+ "tabWidth": 65,
285
+ "tabXOffset": 10,
286
+ "hasSecondTab": false,
287
+ "secondTabText": "Send Back",
288
+ "secondTabOffset": 80,
289
+ "secondTabWidth": 65,
290
+ "cnr_id": "comfy-core",
291
+ "ver": "0.3.57",
292
+ "Node name for S&R": "RandomNoise"
293
+ },
294
+ "widgets_values": [
295
+ 243759308503783,
296
+ "randomize"
297
+ ]
298
+ },
299
+ {
300
+ "id": 731,
301
+ "type": "UNETLoader",
302
+ "pos": [
303
+ -2256,
304
+ 744
305
+ ],
306
+ "size": [
307
+ 370,
308
+ 82
309
+ ],
310
+ "flags": {},
311
+ "order": 8,
312
+ "mode": 0,
313
+ "inputs": [],
314
+ "outputs": [
315
+ {
316
+ "name": "MODEL",
317
+ "type": "MODEL",
318
+ "links": [
319
+ 1366
320
+ ]
321
+ }
322
+ ],
323
+ "properties": {
324
+ "enableTabs": false,
325
+ "tabWidth": 65,
326
+ "tabXOffset": 10,
327
+ "hasSecondTab": false,
328
+ "secondTabText": "Send Back",
329
+ "secondTabOffset": 80,
330
+ "secondTabWidth": 65,
331
+ "cnr_id": "comfy-core",
332
+ "ver": "0.3.57",
333
+ "Node name for S&R": "UNETLoader",
334
+ "models": [
335
+ {
336
+ "name": "Chroma1-HD-fp8_scaled_rev2.safetensors",
337
+ "url": "https://huggingface.co/silveroxides/Chroma1-HD-fp8-scaled/resolve/main/Chroma1-HD-fp8_scaled_rev2.safetensors",
338
+ "directory": "diffusion_models"
339
+ }
340
+ ]
341
+ },
342
+ "widgets_values": [
343
+ "Chroma1-HD-fp8_scaled_rev2.safetensors",
344
+ "default"
345
+ ]
346
+ },
347
+ {
348
+ "id": 733,
349
+ "type": "CLIPLoader",
350
+ "pos": [
351
+ -2256,
352
+ 864
353
+ ],
354
+ "size": [
355
+ 370,
356
+ 110
357
+ ],
358
+ "flags": {},
359
+ "order": 5,
360
+ "mode": 0,
361
+ "inputs": [],
362
+ "outputs": [
363
+ {
364
+ "name": "CLIP",
365
+ "type": "CLIP",
366
+ "links": [
367
+ 1342
368
+ ]
369
+ }
370
+ ],
371
+ "properties": {
372
+ "enableTabs": false,
373
+ "tabWidth": 65,
374
+ "tabXOffset": 10,
375
+ "hasSecondTab": false,
376
+ "secondTabText": "Send Back",
377
+ "secondTabOffset": 80,
378
+ "secondTabWidth": 65,
379
+ "cnr_id": "comfy-core",
380
+ "ver": "0.3.57",
381
+ "Node name for S&R": "CLIPLoader",
382
+ "models": [
383
+ {
384
+ "name": "t5xxl_fp8_e4m3fn_scaled.safetensors",
385
+ "url": "https://huggingface.co/comfyanonymous/flux_text_encoders/resolve/main/t5xxl_fp8_e4m3fn_scaled.safetensors",
386
+ "directory": "text_encoders"
387
+ }
388
+ ]
389
+ },
390
+ "widgets_values": [
391
+ "t5xxl_flan_latest_float8_e4m3fn_scaled_stochastic.safetensors",
392
+ "chroma",
393
+ "default"
394
+ ]
395
+ },
396
+ {
397
+ "id": 737,
398
+ "type": "EmptySD3LatentImage",
399
+ "pos": [
400
+ -2256,
401
+ 1248
402
+ ],
403
+ "size": [
404
+ 370,
405
+ 106
406
+ ],
407
+ "flags": {},
408
+ "order": 7,
409
+ "mode": 0,
410
+ "inputs": [],
411
+ "outputs": [
412
+ {
413
+ "name": "LATENT",
414
+ "type": "LATENT",
415
+ "links": [
416
+ 1354
417
+ ]
418
+ }
419
+ ],
420
+ "properties": {
421
+ "enableTabs": false,
422
+ "tabWidth": 65,
423
+ "tabXOffset": 10,
424
+ "hasSecondTab": false,
425
+ "secondTabText": "Send Back",
426
+ "secondTabOffset": 80,
427
+ "secondTabWidth": 65,
428
+ "cnr_id": "comfy-core",
429
+ "ver": "0.3.59",
430
+ "Node name for S&R": "EmptySD3LatentImage"
431
+ },
432
+ "widgets_values": [
433
+ 1152,
434
+ 1152,
435
+ 1
436
+ ],
437
+ "color": "#323",
438
+ "bgcolor": "#535"
439
+ },
440
+ {
441
+ "id": 739,
442
+ "type": "Note",
443
+ "pos": [
444
+ -1816,
445
+ 664
446
+ ],
447
+ "size": [
448
+ 260,
449
+ 90
450
+ ],
451
+ "flags": {},
452
+ "order": 2,
453
+ "mode": 0,
454
+ "inputs": [],
455
+ "outputs": [],
456
+ "title": "Optional Flow Shift",
457
+ "properties": {},
458
+ "widgets_values": [
459
+ "Flow Shift node set to 1.0 represents intended shift by the creator of the Chroma model and will produce greater detail. "
460
+ ],
461
+ "color": "#432",
462
+ "bgcolor": "#653"
463
+ },
464
+ {
465
+ "id": 740,
466
+ "type": "SaveImage",
467
+ "pos": [
468
+ -1088,
469
+ 616
470
+ ],
471
+ "size": [
472
+ 1020,
473
+ 1140
474
+ ],
475
+ "flags": {},
476
+ "order": 17,
477
+ "mode": 0,
478
+ "inputs": [
479
+ {
480
+ "name": "images",
481
+ "type": "IMAGE",
482
+ "link": 1341
483
+ }
484
+ ],
485
+ "outputs": [],
486
+ "properties": {
487
+ "enableTabs": false,
488
+ "tabWidth": 65,
489
+ "tabXOffset": 10,
490
+ "hasSecondTab": false,
491
+ "secondTabText": "Send Back",
492
+ "secondTabOffset": 80,
493
+ "secondTabWidth": 65,
494
+ "cnr_id": "comfy-core",
495
+ "ver": "0.3.59"
496
+ },
497
+ "widgets_values": [
498
+ "ComfyUI"
499
+ ]
500
+ },
501
+ {
502
+ "id": 741,
503
+ "type": "T5TokenizerOptions",
504
+ "pos": [
505
+ -1800,
506
+ 888
507
+ ],
508
+ "size": [
509
+ 210,
510
+ 82
511
+ ],
512
+ "flags": {},
513
+ "order": 9,
514
+ "mode": 0,
515
+ "inputs": [
516
+ {
517
+ "name": "clip",
518
+ "type": "CLIP",
519
+ "link": 1342
520
+ }
521
+ ],
522
+ "outputs": [
523
+ {
524
+ "name": "CLIP",
525
+ "type": "CLIP",
526
+ "links": [
527
+ 1356,
528
+ 1359
529
+ ]
530
+ }
531
+ ],
532
+ "properties": {
533
+ "enableTabs": false,
534
+ "tabWidth": 65,
535
+ "tabXOffset": 10,
536
+ "hasSecondTab": false,
537
+ "secondTabText": "Send Back",
538
+ "secondTabOffset": 80,
539
+ "secondTabWidth": 65,
540
+ "cnr_id": "comfy-core",
541
+ "ver": "0.3.59",
542
+ "Node name for S&R": "T5TokenizerOptions"
543
+ },
544
+ "widgets_values": [
545
+ 0,
546
+ 0
547
+ ]
548
+ },
549
+ {
550
+ "id": 742,
551
+ "type": "Note",
552
+ "pos": [
553
+ -1832,
554
+ 1008
555
+ ],
556
+ "size": [
557
+ 264,
558
+ 128
559
+ ],
560
+ "flags": {},
561
+ "order": 3,
562
+ "mode": 0,
563
+ "inputs": [],
564
+ "outputs": [],
565
+ "title": "Optional Padding",
566
+ "properties": {},
567
+ "widgets_values": [
568
+ "min_padding 1 is the official way. setting it to 0 works too. might vary depending on t5 variant"
569
+ ],
570
+ "color": "#432",
571
+ "bgcolor": "#653"
572
+ },
573
+ {
574
+ "id": 743,
575
+ "type": "MarkdownNote",
576
+ "pos": [
577
+ -3640,
578
+ 464
579
+ ],
580
+ "size": [
581
+ 1312,
582
+ 1480
583
+ ],
584
+ "flags": {},
585
+ "order": 6,
586
+ "mode": 0,
587
+ "inputs": [],
588
+ "outputs": [],
589
+ "properties": {},
590
+ "widgets_values": [
591
+ "### Chroma final model has been released and is hosted [here](https://huggingface.co/lodestones/Chroma1-HD). You can visit [here](https://huggingface.co/lodestones/Chroma) to get previous versions for download. For other models, if you have used models related to Flux, then you probably don't need to download them again.\n\n<br>\n\n# diffusion_models\n\n### [Chroma1-HD.safetensors](https://huggingface.co/lodestones/Chroma1-HD/resolve/main/Chroma1-HD.safetensors)\n\n## or fp8_scaled version for lower VRAM GPU\n\n### [Chroma1-HD-fp8_scaled_rev2.safetensors](https://huggingface.co/silveroxides/Chroma1-HD-fp8-scaled/resolve/main/Chroma1-HD-fp8_scaled_rev2.safetensors)\n\n<br>\n\n## or fp8_scaled hybrid precision models for better output when using fp8\n\n## They will require this custom node\n\n### [ComfyUI_Hybrid-Scaled_fp8-Loader](https://github.com/silveroxides/ComfyUI_Hybrid-Scaled_fp8-Loader) in order to be loaded properly.\n\n### Large variant must use pruned flash-heun LoRAs while small can use regular ones.\n\n### [Chroma1-HD-fp8_scaled_original_hybrid_small_rev2.safetensors](https://huggingface.co/silveroxides/Chroma1-HD-fp8-scaled/blob/main/Chroma1-HD-fp8_scaled_original_hybrid_small_rev2.safetensors)\n\n### [Chroma1-HD-fp8_scaled_original_hybrid_large_rev2.safetensors](https://huggingface.co/silveroxides/Chroma1-HD-fp8-scaled/blob/main/Chroma1-HD-fp8_scaled_original_hybrid_large_rev2.safetensors)\n\n<br>\n\n\n# text_encoders\n\n\n### [t5xxl_fp16](https://huggingface.co/comfyanonymous/flux_text_encoders/resolve/main/t5xxl_fp16.safetensors) or [t5xxl_fp8_e4m3fn_scaled.safetensors](https://huggingface.co/comfyanonymous/flux_text_encoders/resolve/main/t5xxl_fp8_e4m3fn_scaled.safetensors)\n\n### alternatively [flan-t5-xxl-fp16.safetensors](https://huggingface.co/silveroxides/flan-t5-xxl-encoder-only/blob/main/flan-t5-xxl-fp16.safetensors) or [flan-t5-xxl_float8_e4m3fn_scaled_stochastic.safetensors](https://huggingface.co/silveroxides/flan-t5-xxl-encoder-only/blob/main/flan-t5-xxl_float8_e4m3fn_scaled_stochastic.safetensors)\n\n### recommended flan-t5-xxl for precision: [flan-t5-xxl-Q8_0.gguf](https://huggingface.co/silveroxides/flan-t5-xxl-encoder-only-GGUF/blob/main/flan-t5-xxl-Q8_0.gguf)\n\n### GGUF models will require [ComfyUI-GGUF](https://github.com/city96/ComfyUI-GGUF) in order to load.\n\n<br>\n\n# vae\n\n### [ae.safetensors](https://huggingface.co/Comfy-Org/Lumina_Image_2.0_Repackaged/resolve/main/split_files/vae/ae.safetensors)\n\n<br>\n\n```\n📂 ComfyUI/\n├─ 📂 models/\n│ ├─ 📂 diffusion_models/\n│ │ ├── Chroma1-HD-fp8_scaled_rev2_learned_topp0.25_k16-2688_svd.safetensors\n│ │ └── Chroma1-HD.safetensors\n│ ├─ 📂 text_encoders/\n│ │ ├── t5xxl_fp8_e4m3fn_scaled.safetensors\n│ │ └── t5xxl_fp16.safetensors \n│ └─ 📂 vae/\n│ └── ae.safetensors\n```\n"
592
+ ],
593
+ "color": "#432",
594
+ "bgcolor": "#653"
595
+ },
596
+ {
597
+ "id": 747,
598
+ "type": "SamplerCustomAdvanced",
599
+ "pos": [
600
+ -1464,
601
+ 1256
602
+ ],
603
+ "size": [
604
+ 280,
605
+ 326
606
+ ],
607
+ "flags": {},
608
+ "order": 15,
609
+ "mode": 0,
610
+ "inputs": [
611
+ {
612
+ "name": "noise",
613
+ "type": "NOISE",
614
+ "link": 1350
615
+ },
616
+ {
617
+ "name": "guider",
618
+ "type": "GUIDER",
619
+ "link": 1351
620
+ },
621
+ {
622
+ "name": "sampler",
623
+ "type": "SAMPLER",
624
+ "link": 1352
625
+ },
626
+ {
627
+ "name": "sigmas",
628
+ "type": "SIGMAS",
629
+ "link": 1376
630
+ },
631
+ {
632
+ "name": "latent_image",
633
+ "type": "LATENT",
634
+ "link": 1354
635
+ }
636
+ ],
637
+ "outputs": [
638
+ {
639
+ "name": "output",
640
+ "type": "LATENT",
641
+ "links": [
642
+ 1355
643
+ ]
644
+ },
645
+ {
646
+ "name": "denoised_output",
647
+ "type": "LATENT",
648
+ "links": null
649
+ }
650
+ ],
651
+ "properties": {
652
+ "enableTabs": false,
653
+ "tabWidth": 65,
654
+ "tabXOffset": 10,
655
+ "hasSecondTab": false,
656
+ "secondTabText": "Send Back",
657
+ "secondTabOffset": 80,
658
+ "secondTabWidth": 65,
659
+ "cnr_id": "comfy-core",
660
+ "ver": "0.3.59",
661
+ "Node name for S&R": "SamplerCustomAdvanced"
662
+ },
663
+ "widgets_values": []
664
+ },
665
+ {
666
+ "id": 748,
667
+ "type": "CLIPTextEncode",
668
+ "pos": [
669
+ -1528,
670
+ 560
671
+ ],
672
+ "size": [
673
+ 392,
674
+ 288
675
+ ],
676
+ "flags": {},
677
+ "order": 11,
678
+ "mode": 0,
679
+ "inputs": [
680
+ {
681
+ "name": "clip",
682
+ "type": "CLIP",
683
+ "link": 1356
684
+ }
685
+ ],
686
+ "outputs": [
687
+ {
688
+ "name": "CONDITIONING",
689
+ "type": "CONDITIONING",
690
+ "links": [
691
+ 1358
692
+ ]
693
+ }
694
+ ],
695
+ "title": "CLIP Text Encode (Positive Prompt)",
696
+ "properties": {
697
+ "enableTabs": false,
698
+ "tabWidth": 65,
699
+ "tabXOffset": 10,
700
+ "hasSecondTab": false,
701
+ "secondTabText": "Send Back",
702
+ "secondTabOffset": 80,
703
+ "secondTabWidth": 65,
704
+ "cnr_id": "comfy-core",
705
+ "ver": "0.3.59",
706
+ "Node name for S&R": "CLIPTextEncode"
707
+ },
708
+ "widgets_values": [
709
+ "This is a close-up photograph from a nature documentary capturing the right side of the face of a tiger. The photograph is centered on its highly detailed and speckled eye surrounded by intricately detailed fur. Overlaid at the center of the image is a title text that says \"CHROMA1-HD\" in a large white 3D letters. Amateur photography. unfiltered. natural lighting. anatomically correct. subtle shadows. perfect composition. highest quality. detailed. sharp focus"
710
+ ],
711
+ "color": "#232",
712
+ "bgcolor": "#353"
713
+ },
714
+ {
715
+ "id": 749,
716
+ "type": "CLIPTextEncode",
717
+ "pos": [
718
+ -1528,
719
+ 888
720
+ ],
721
+ "size": [
722
+ 400,
723
+ 248
724
+ ],
725
+ "flags": {},
726
+ "order": 12,
727
+ "mode": 0,
728
+ "inputs": [
729
+ {
730
+ "name": "clip",
731
+ "type": "CLIP",
732
+ "link": 1359
733
+ }
734
+ ],
735
+ "outputs": [
736
+ {
737
+ "name": "CONDITIONING",
738
+ "type": "CONDITIONING",
739
+ "links": [
740
+ 1361
741
+ ]
742
+ }
743
+ ],
744
+ "title": "CLIP Text Encode (Negative Prompt)",
745
+ "properties": {
746
+ "enableTabs": false,
747
+ "tabWidth": 65,
748
+ "tabXOffset": 10,
749
+ "hasSecondTab": false,
750
+ "secondTabText": "Send Back",
751
+ "secondTabOffset": 80,
752
+ "secondTabWidth": 65,
753
+ "cnr_id": "comfy-core",
754
+ "ver": "0.3.59",
755
+ "Node name for S&R": "CLIPTextEncode"
756
+ },
757
+ "widgets_values": [
758
+ "This greyscale unfinished sketch has bad proportions, is featureless and disfigured. It is a blurry ugly mess and with excessive gaussian blur. It is riddled with watermarks and signatures. Everything is smudged with leaking colors and nonsensical orientation of objects. Messy and abstract image filled with artifacts disrupt the coherency of the overall composition. The image has extreme chromatic abberations and inconsistent lighting. Dull, monochrome colors and countless artistic errors. "
759
+ ],
760
+ "color": "#322",
761
+ "bgcolor": "#533"
762
+ },
763
+ {
764
+ "id": 751,
765
+ "type": "BetaSamplingScheduler",
766
+ "pos": [
767
+ -1752,
768
+ 1608
769
+ ],
770
+ "size": [
771
+ 270,
772
+ 106
773
+ ],
774
+ "flags": {},
775
+ "order": 13,
776
+ "mode": 0,
777
+ "inputs": [
778
+ {
779
+ "name": "model",
780
+ "type": "MODEL",
781
+ "link": 1372
782
+ }
783
+ ],
784
+ "outputs": [
785
+ {
786
+ "name": "SIGMAS",
787
+ "type": "SIGMAS",
788
+ "links": [
789
+ 1376
790
+ ]
791
+ }
792
+ ],
793
+ "properties": {
794
+ "enableTabs": false,
795
+ "tabWidth": 65,
796
+ "tabXOffset": 10,
797
+ "hasSecondTab": false,
798
+ "secondTabText": "Send Back",
799
+ "secondTabOffset": 80,
800
+ "secondTabWidth": 65,
801
+ "cnr_id": "comfy-core",
802
+ "ver": "0.3.65",
803
+ "Node name for S&R": "BetaSamplingScheduler"
804
+ },
805
+ "widgets_values": [
806
+ 26,
807
+ 0.45000000000000007,
808
+ 0.44999999999999984
809
+ ]
810
+ }
811
+ ],
812
+ "links": [
813
+ [
814
+ 1252,
815
+ 710,
816
+ 0,
817
+ 298,
818
+ 1,
819
+ "VAE"
820
+ ],
821
+ [
822
+ 1341,
823
+ 298,
824
+ 0,
825
+ 740,
826
+ 0,
827
+ "IMAGE"
828
+ ],
829
+ [
830
+ 1342,
831
+ 733,
832
+ 0,
833
+ 741,
834
+ 0,
835
+ "CLIP"
836
+ ],
837
+ [
838
+ 1350,
839
+ 718,
840
+ 0,
841
+ 747,
842
+ 0,
843
+ "NOISE"
844
+ ],
845
+ [
846
+ 1351,
847
+ 694,
848
+ 0,
849
+ 747,
850
+ 1,
851
+ "GUIDER"
852
+ ],
853
+ [
854
+ 1352,
855
+ 700,
856
+ 0,
857
+ 747,
858
+ 2,
859
+ "SAMPLER"
860
+ ],
861
+ [
862
+ 1354,
863
+ 737,
864
+ 0,
865
+ 747,
866
+ 4,
867
+ "LATENT"
868
+ ],
869
+ [
870
+ 1355,
871
+ 747,
872
+ 0,
873
+ 298,
874
+ 0,
875
+ "LATENT"
876
+ ],
877
+ [
878
+ 1356,
879
+ 741,
880
+ 0,
881
+ 748,
882
+ 0,
883
+ "CLIP"
884
+ ],
885
+ [
886
+ 1358,
887
+ 748,
888
+ 0,
889
+ 694,
890
+ 1,
891
+ "CONDITIONING"
892
+ ],
893
+ [
894
+ 1359,
895
+ 741,
896
+ 0,
897
+ 749,
898
+ 0,
899
+ "CLIP"
900
+ ],
901
+ [
902
+ 1361,
903
+ 749,
904
+ 0,
905
+ 694,
906
+ 2,
907
+ "CONDITIONING"
908
+ ],
909
+ [
910
+ 1366,
911
+ 731,
912
+ 0,
913
+ 701,
914
+ 0,
915
+ "MODEL"
916
+ ],
917
+ [
918
+ 1370,
919
+ 701,
920
+ 0,
921
+ 694,
922
+ 0,
923
+ "MODEL"
924
+ ],
925
+ [
926
+ 1372,
927
+ 701,
928
+ 0,
929
+ 751,
930
+ 0,
931
+ "MODEL"
932
+ ],
933
+ [
934
+ 1376,
935
+ 751,
936
+ 0,
937
+ 747,
938
+ 3,
939
+ "SIGMAS"
940
+ ]
941
+ ],
942
+ "groups": [
943
+ {
944
+ "id": 4,
945
+ "title": "Sampler Settings",
946
+ "bounding": [
947
+ -1840,
948
+ 1160,
949
+ 730,
950
+ 600
951
+ ],
952
+ "color": "#3f789e",
953
+ "font_size": 24,
954
+ "flags": {}
955
+ },
956
+ {
957
+ "id": 5,
958
+ "title": "Step 1: Load models",
959
+ "bounding": [
960
+ -2288,
961
+ 600,
962
+ 440,
963
+ 552
964
+ ],
965
+ "color": "#3f789e",
966
+ "font_size": 24,
967
+ "flags": {}
968
+ },
969
+ {
970
+ "id": 6,
971
+ "title": "Optional",
972
+ "bounding": [
973
+ -1840,
974
+ 592,
975
+ 296,
976
+ 560
977
+ ],
978
+ "color": "#3f789e",
979
+ "font_size": 24,
980
+ "flags": {}
981
+ },
982
+ {
983
+ "id": 7,
984
+ "title": "Step 2: Image Size",
985
+ "bounding": [
986
+ -2288,
987
+ 1160,
988
+ 440,
989
+ 220
990
+ ],
991
+ "color": "#3f789e",
992
+ "font_size": 24,
993
+ "flags": {}
994
+ },
995
+ {
996
+ "id": 8,
997
+ "title": "Step 3: Prompt",
998
+ "bounding": [
999
+ -1536,
1000
+ 496,
1001
+ 424,
1002
+ 656
1003
+ ],
1004
+ "color": "#3f789e",
1005
+ "font_size": 24,
1006
+ "flags": {}
1007
+ }
1008
+ ],
1009
+ "config": {},
1010
+ "extra": {
1011
+ "ds": {
1012
+ "scale": 1.1290649084923035,
1013
+ "offset": [
1014
+ 2298.879806513992,
1015
+ -861.8062258198179
1016
+ ]
1017
+ },
1018
+ "frontendVersion": "1.28.7",
1019
+ "VHS_latentpreview": false,
1020
+ "VHS_latentpreviewrate": 0,
1021
+ "VHS_MetadataImage": true,
1022
+ "VHS_KeepIntermediate": true
1023
+ },
1024
+ "version": 0.4
1025
+ }
README.md ADDED
@@ -0,0 +1,181 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ pipeline_tag: text-to-image
4
+ ---
5
+ # Chroma1-HD
6
+
7
+ Chroma1-HD is an **8.9B** parameter text-to-image foundational model based on **FLUX.1-schnell**. It is fully **Apache 2.0 licensed**, ensuring that anyone can use, modify, and build upon it.
8
+
9
+ As a **base model**, Chroma1 is intentionally designed to be an excellent starting point for **finetuning**. It provides a strong, neutral foundation for developers, researchers, and artists to create specialized models.
10
+
11
+ for the fast CFG "baked" version please go to [Chroma1-Flash](https://huggingface.co/lodestones/Chroma1-Flash).
12
+
13
+ ### Key Features
14
+ * **High-Performance Base:** 8.9B parameters, built on the powerful FLUX.1 architecture.
15
+ * **Easily Finetunable:** Designed as an ideal checkpoint for creating custom, specialized models.
16
+ * **Community-Driven & Open-Source:** Fully transparent with an Apache 2.0 license, and training history.
17
+ * **Flexible by Design:** Provides a flexible foundation for a wide range of generative tasks.
18
+
19
+ ## Special Thanks
20
+ A massive thank you to our supporters who make this project possible.
21
+ * **Anonymous donor** whose incredible generosity funded the pretraining run and data collections. Your support has been transformative for open-source AI.
22
+ * **Fictional.ai** for their fantastic support and for helping push the boundaries of open-source AI. You can try Chroma on their platform:
23
+
24
+ [![FictionalChromaBanner_1.png](./images/FictionalChromaBanner_1.png)](https://fictional.ai/?ref=chroma_hf)
25
+
26
+ ## How to Use
27
+
28
+ ### `diffusers` Library
29
+
30
+ install the requirements
31
+
32
+ `pip install transformers diffusers sentencepiece accelerate`
33
+
34
+ ```python
35
+ import torch
36
+ from diffusers import ChromaPipeline
37
+
38
+ pipe = ChromaPipeline.from_pretrained("lodestones/Chroma1-HD", torch_dtype=torch.bfloat16)
39
+ pipe.enable_model_cpu_offload()
40
+
41
+ prompt = [
42
+ "A high-fashion close-up portrait of a blonde woman in clear sunglasses. The image uses a bold teal and red color split for dramatic lighting. The background is a simple teal-green. The photo is sharp and well-composed, and is designed for viewing with anaglyph 3D glasses for optimal effect. It looks professionally done."
43
+ ]
44
+ negative_prompt = ["low quality, ugly, unfinished, out of focus, deformed, disfigure, blurry, smudged, restricted palette, flat colors"]
45
+
46
+ image = pipe(
47
+ prompt=prompt,
48
+ negative_prompt=negative_prompt,
49
+ generator=torch.Generator("cpu").manual_seed(433),
50
+ num_inference_steps=40,
51
+ guidance_scale=3.0,
52
+ num_images_per_prompt=1,
53
+ ).images[0]
54
+ image.save("chroma.png")
55
+ ```
56
+
57
+ Quantized inference using gemlite
58
+
59
+ ```py
60
+ import torch
61
+ from diffusers import ChromaPipeline
62
+
63
+ pipe = ChromaPipeline.from_pretrained("lodestones/Chroma1-HD", torch_dtype=torch.float16)
64
+ #pipe.enable_model_cpu_offload()
65
+
66
+ #######################################################
67
+ import gemlite
68
+ device = 'cuda:0'
69
+ processor = gemlite.helper.A8W8_int8_dynamic
70
+ #processor = gemlite.helper.A8W8_fp8_dynamic
71
+ #processor = gemlite.helper.A16W4_MXFP
72
+
73
+ for name, module in pipe.transformer.named_modules():
74
+ module.name = name
75
+
76
+ def patch_linearlayers(model, fct):
77
+ for name, layer in model.named_children():
78
+ if isinstance(layer, torch.nn.Linear):
79
+ setattr(model, name, fct(layer, name))
80
+ else:
81
+ patch_linearlayers(layer, fct)
82
+
83
+ def patch_linear_to_gemlite(layer, name):
84
+ layer = layer.to(device, non_blocking=True)
85
+ try:
86
+ return processor(device=device).from_linear(layer)
87
+ except Exception as exception:
88
+ print('Skipping gemlite conversion for: ' + str(layer.name), exception)
89
+ return layer
90
+
91
+ patch_linearlayers(pipe.transformer, patch_linear_to_gemlite)
92
+ torch.cuda.synchronize()
93
+ torch.cuda.empty_cache()
94
+
95
+ pipe.to(device)
96
+ pipe.transformer.forward = torch.compile(pipe.transformer.forward, fullgraph=True)
97
+ pipe.vae.forward = torch.compile(pipe.vae.forward, fullgraph=True)
98
+ #pipe.set_progress_bar_config(disable=True)
99
+ #######################################################
100
+
101
+ prompt = [
102
+ "A high-fashion close-up portrait of a blonde woman in clear sunglasses. The image uses a bold teal and red color split for dramatic lighting. The background is a simple teal-green. The photo is sharp and well-composed, and is designed for viewing with anaglyph 3D glasses for optimal effect. It looks professionally done."
103
+ ]
104
+ negative_prompt = ["low quality, ugly, unfinished, out of focus, deformed, disfigure, blurry, smudged, restricted palette, flat colors"]
105
+
106
+ import time
107
+ for _ in range(3):
108
+ t_start = time.time()
109
+ image = pipe(
110
+ prompt=prompt,
111
+ negative_prompt=negative_prompt,
112
+ generator=torch.Generator("cpu").manual_seed(433),
113
+ num_inference_steps=40,
114
+ guidance_scale=3.0,
115
+ num_images_per_prompt=1,
116
+ ).images[0]
117
+ t_end = time.time()
118
+ print(f"Took: {t_end - t_start} secs.") #66.1242527961731 -> 27.72 sec
119
+
120
+ image.save("chroma.png")
121
+ ```
122
+
123
+ ComfyUI
124
+ For advanced users and customized workflows, you can use Chroma with ComfyUI.
125
+
126
+ **Requirements:**
127
+ * A working ComfyUI installation.
128
+ * [Chroma checkpoint](https://huggingface.co/lodestones/Chroma) (latest version).
129
+ * [T5 XXL Text Encoder](https://huggingface.co/comfyanonymous/flux_text_encoders/resolve/main/t5xxl_fp16.safetensors).
130
+ * [FLUX VAE](https://huggingface.co/lodestones/Chroma/resolve/main/ae.safetensors).
131
+ * [Chroma Workflow JSON](https://huggingface.co/lodestones/Chroma1-HD/resolve/main/ComfyUI_Chroma1-HD_T2I-workflow.json).
132
+
133
+ ![Chroma Workflow](./ComfyUI_Chroma1-HD_T2I-sample.png)
134
+ ![Workflow Overview](./ComfyUI_Chroma1-HD_T2I-overview.png)
135
+
136
+ **Setup:**
137
+ 1. Place the `T5_xxl` model in your `ComfyUI/models/clip` folder.
138
+ 2. Place the `FLUX VAE` in your `ComfyUI/models/vae` folder.
139
+ 3. Place the `Chroma checkpoint` in your `ComfyUI/models/diffusion_models` folder.
140
+ 4. Load the Chroma workflow file into ComfyUI and run.
141
+
142
+ ## Model Details
143
+ * **Architecture:** Based on the 8.9B parameter FLUX.1-schnell model.
144
+ * **Training Data:** Trained on a 5M sample dataset curated from a 20M pool, including artistic, photographic, and niche styles.
145
+ * **Technical Report:** A comprehensive technical paper detailing the architectural modifications and training process is forthcoming.
146
+
147
+ ## Intended Use
148
+ Chroma is intended to be used as a **base model** for researchers and developers to build upon. It is ideal for:
149
+ * Finetuning on specific styles, concepts, or characters.
150
+ * Research into generative model behavior, alignment, and safety.
151
+ * As a foundational component in larger AI systems.
152
+
153
+ ## Limitations and Bias Statement
154
+ Chroma is trained on a broad, filtered dataset from the internet. As such, it may reflect the biases and stereotypes present in its training data. The model is released in a state as is and has not been aligned with a specific safety filter.
155
+
156
+ Users are responsible for their own use of this model. It has the potential to generate content that may be considered harmful, explicit, or offensive. I encourage developers to implement appropriate safeguards and ethical considerations in their downstream applications.
157
+
158
+ ## Summary of Architectural Modifications
159
+ *(For a full breakdown, tech report soon-ish.)*
160
+
161
+ * **12B → 8.9B Parameters:**
162
+ * **TL;DR:** I replaced a 3.3B parameter timestep-encoding layer with a more efficient 250M parameter FFN, as the original was vastly oversized for its task.
163
+ * **MMDiT Masking:**
164
+ * **TL;DR:** Masking T5 padding tokens enhanced fidelity and increased training stability by preventing the model from focusing on irrelevant `<pad>` tokens.
165
+ * **Custom Timestep Distributions:**
166
+ * **TL;DR:** I implemented a custom timestep sampling distribution (`-x^2`) to prevent loss spikes and ensure the model trains effectively on both high-noise and low-noise regions.
167
+
168
+ ## P.S
169
+ Chroma1-HD is not the old Chroma-v.50 it has been retrained from v.48
170
+
171
+ ## Citation
172
+ ```
173
+ @misc{rock2025chroma,
174
+ author = {Lodestone Rock},
175
+ title = {Chroma1-HD},
176
+ year = {2025},
177
+ publisher = {Hugging Face},
178
+ journal = {Hugging Face repository},
179
+ howpublished = {\url{https://huggingface.co/lodestones/Chroma1-HD}},
180
+ }
181
+ ```
configuration.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"framework": "pytorch", "task": "text-to-image", "allow_remote": true}
images/FictionalChromaBanner_1.png ADDED

Git LFS Details

  • SHA256: 05b4e4ff23d2ea11dc518cbcf071d1cacb1786d8ec2e0aa86f03d50018cf592d
  • Pointer size: 132 Bytes
  • Size of remote file: 1.01 MB
model_index.json ADDED
@@ -0,0 +1,32 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_class_name": "ChromaPipeline",
3
+ "_diffusers_version": "0.35.1",
4
+ "feature_extractor": [
5
+ null,
6
+ null
7
+ ],
8
+ "image_encoder": [
9
+ null,
10
+ null
11
+ ],
12
+ "scheduler": [
13
+ "diffusers",
14
+ "FlowMatchEulerDiscreteScheduler"
15
+ ],
16
+ "text_encoder": [
17
+ "transformers",
18
+ "T5EncoderModel"
19
+ ],
20
+ "tokenizer": [
21
+ "transformers",
22
+ "T5Tokenizer"
23
+ ],
24
+ "transformer": [
25
+ "diffusers",
26
+ "ChromaTransformer2DModel"
27
+ ],
28
+ "vae": [
29
+ "diffusers",
30
+ "AutoencoderKL"
31
+ ]
32
+ }
scheduler/scheduler_config.json ADDED
@@ -0,0 +1,18 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_class_name": "FlowMatchEulerDiscreteScheduler",
3
+ "_diffusers_version": "0.35.1",
4
+ "base_image_seq_len": 256,
5
+ "base_shift": 0.5,
6
+ "invert_sigmas": false,
7
+ "max_image_seq_len": 4096,
8
+ "max_shift": 1.15,
9
+ "num_train_timesteps": 1000,
10
+ "shift": 3.0,
11
+ "shift_terminal": null,
12
+ "stochastic_sampling": false,
13
+ "time_shift_type": "exponential",
14
+ "use_beta_sigmas": false,
15
+ "use_dynamic_shifting": false,
16
+ "use_exponential_sigmas": false,
17
+ "use_karras_sigmas": false
18
+ }
svdq-fp4_r32-Chroma1-HD.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b791d4ad7e3a3da2e952b22c2b99fbc1cf9f7d2562b97ba13f416a78d056ad66
3
+ size 5675429184
svdq-int4_r32-Chroma1-HD.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c09c732d22fb8e9887b6953adde361cdabab1725e318129ec1d8c63908ac64dc
3
+ size 5405033152
text_encoder/config.json ADDED
@@ -0,0 +1,31 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "architectures": [
3
+ "T5EncoderModel"
4
+ ],
5
+ "classifier_dropout": 0.0,
6
+ "d_ff": 10240,
7
+ "d_kv": 64,
8
+ "d_model": 4096,
9
+ "decoder_start_token_id": 0,
10
+ "dense_act_fn": "gelu_new",
11
+ "dropout_rate": 0.1,
12
+ "eos_token_id": 1,
13
+ "feed_forward_proj": "gated-gelu",
14
+ "initializer_factor": 1.0,
15
+ "is_encoder_decoder": true,
16
+ "is_gated_act": true,
17
+ "layer_norm_epsilon": 1e-06,
18
+ "model_type": "t5",
19
+ "num_decoder_layers": 24,
20
+ "num_heads": 64,
21
+ "num_layers": 24,
22
+ "output_past": true,
23
+ "pad_token_id": 0,
24
+ "relative_attention_max_distance": 128,
25
+ "relative_attention_num_buckets": 32,
26
+ "tie_word_embeddings": false,
27
+ "torch_dtype": "bfloat16",
28
+ "transformers_version": "4.53.0",
29
+ "use_cache": true,
30
+ "vocab_size": 32128
31
+ }
text_encoder/model-00001-of-00002.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ec87bffd1923e8b2774a6d240c922a41f6143081d52cf83b8fe39e9d838c893e
3
+ size 4994582224
text_encoder/model-00002-of-00002.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a5640855b301fcdbceddfa90ae8066cd9414aff020552a201a255ecf2059da00
3
+ size 4530066360
text_encoder/model.safetensors.index.json ADDED
@@ -0,0 +1,227 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "metadata": {
3
+ "total_parameters": 4762310656,
4
+ "total_size": 9524621312
5
+ },
6
+ "weight_map": {
7
+ "encoder.block.0.layer.0.SelfAttention.k.weight": "model-00001-of-00002.safetensors",
8
+ "encoder.block.0.layer.0.SelfAttention.o.weight": "model-00001-of-00002.safetensors",
9
+ "encoder.block.0.layer.0.SelfAttention.q.weight": "model-00001-of-00002.safetensors",
10
+ "encoder.block.0.layer.0.SelfAttention.relative_attention_bias.weight": "model-00001-of-00002.safetensors",
11
+ "encoder.block.0.layer.0.SelfAttention.v.weight": "model-00001-of-00002.safetensors",
12
+ "encoder.block.0.layer.0.layer_norm.weight": "model-00001-of-00002.safetensors",
13
+ "encoder.block.0.layer.1.DenseReluDense.wi_0.weight": "model-00001-of-00002.safetensors",
14
+ "encoder.block.0.layer.1.DenseReluDense.wi_1.weight": "model-00001-of-00002.safetensors",
15
+ "encoder.block.0.layer.1.DenseReluDense.wo.weight": "model-00001-of-00002.safetensors",
16
+ "encoder.block.0.layer.1.layer_norm.weight": "model-00001-of-00002.safetensors",
17
+ "encoder.block.1.layer.0.SelfAttention.k.weight": "model-00001-of-00002.safetensors",
18
+ "encoder.block.1.layer.0.SelfAttention.o.weight": "model-00001-of-00002.safetensors",
19
+ "encoder.block.1.layer.0.SelfAttention.q.weight": "model-00001-of-00002.safetensors",
20
+ "encoder.block.1.layer.0.SelfAttention.v.weight": "model-00001-of-00002.safetensors",
21
+ "encoder.block.1.layer.0.layer_norm.weight": "model-00001-of-00002.safetensors",
22
+ "encoder.block.1.layer.1.DenseReluDense.wi_0.weight": "model-00001-of-00002.safetensors",
23
+ "encoder.block.1.layer.1.DenseReluDense.wi_1.weight": "model-00001-of-00002.safetensors",
24
+ "encoder.block.1.layer.1.DenseReluDense.wo.weight": "model-00001-of-00002.safetensors",
25
+ "encoder.block.1.layer.1.layer_norm.weight": "model-00001-of-00002.safetensors",
26
+ "encoder.block.10.layer.0.SelfAttention.k.weight": "model-00001-of-00002.safetensors",
27
+ "encoder.block.10.layer.0.SelfAttention.o.weight": "model-00001-of-00002.safetensors",
28
+ "encoder.block.10.layer.0.SelfAttention.q.weight": "model-00001-of-00002.safetensors",
29
+ "encoder.block.10.layer.0.SelfAttention.v.weight": "model-00001-of-00002.safetensors",
30
+ "encoder.block.10.layer.0.layer_norm.weight": "model-00001-of-00002.safetensors",
31
+ "encoder.block.10.layer.1.DenseReluDense.wi_0.weight": "model-00001-of-00002.safetensors",
32
+ "encoder.block.10.layer.1.DenseReluDense.wi_1.weight": "model-00001-of-00002.safetensors",
33
+ "encoder.block.10.layer.1.DenseReluDense.wo.weight": "model-00001-of-00002.safetensors",
34
+ "encoder.block.10.layer.1.layer_norm.weight": "model-00001-of-00002.safetensors",
35
+ "encoder.block.11.layer.0.SelfAttention.k.weight": "model-00001-of-00002.safetensors",
36
+ "encoder.block.11.layer.0.SelfAttention.o.weight": "model-00001-of-00002.safetensors",
37
+ "encoder.block.11.layer.0.SelfAttention.q.weight": "model-00001-of-00002.safetensors",
38
+ "encoder.block.11.layer.0.SelfAttention.v.weight": "model-00001-of-00002.safetensors",
39
+ "encoder.block.11.layer.0.layer_norm.weight": "model-00001-of-00002.safetensors",
40
+ "encoder.block.11.layer.1.DenseReluDense.wi_0.weight": "model-00001-of-00002.safetensors",
41
+ "encoder.block.11.layer.1.DenseReluDense.wi_1.weight": "model-00001-of-00002.safetensors",
42
+ "encoder.block.11.layer.1.DenseReluDense.wo.weight": "model-00001-of-00002.safetensors",
43
+ "encoder.block.11.layer.1.layer_norm.weight": "model-00001-of-00002.safetensors",
44
+ "encoder.block.12.layer.0.SelfAttention.k.weight": "model-00001-of-00002.safetensors",
45
+ "encoder.block.12.layer.0.SelfAttention.o.weight": "model-00002-of-00002.safetensors",
46
+ "encoder.block.12.layer.0.SelfAttention.q.weight": "model-00001-of-00002.safetensors",
47
+ "encoder.block.12.layer.0.SelfAttention.v.weight": "model-00001-of-00002.safetensors",
48
+ "encoder.block.12.layer.0.layer_norm.weight": "model-00002-of-00002.safetensors",
49
+ "encoder.block.12.layer.1.DenseReluDense.wi_0.weight": "model-00002-of-00002.safetensors",
50
+ "encoder.block.12.layer.1.DenseReluDense.wi_1.weight": "model-00002-of-00002.safetensors",
51
+ "encoder.block.12.layer.1.DenseReluDense.wo.weight": "model-00002-of-00002.safetensors",
52
+ "encoder.block.12.layer.1.layer_norm.weight": "model-00002-of-00002.safetensors",
53
+ "encoder.block.13.layer.0.SelfAttention.k.weight": "model-00002-of-00002.safetensors",
54
+ "encoder.block.13.layer.0.SelfAttention.o.weight": "model-00002-of-00002.safetensors",
55
+ "encoder.block.13.layer.0.SelfAttention.q.weight": "model-00002-of-00002.safetensors",
56
+ "encoder.block.13.layer.0.SelfAttention.v.weight": "model-00002-of-00002.safetensors",
57
+ "encoder.block.13.layer.0.layer_norm.weight": "model-00002-of-00002.safetensors",
58
+ "encoder.block.13.layer.1.DenseReluDense.wi_0.weight": "model-00002-of-00002.safetensors",
59
+ "encoder.block.13.layer.1.DenseReluDense.wi_1.weight": "model-00002-of-00002.safetensors",
60
+ "encoder.block.13.layer.1.DenseReluDense.wo.weight": "model-00002-of-00002.safetensors",
61
+ "encoder.block.13.layer.1.layer_norm.weight": "model-00002-of-00002.safetensors",
62
+ "encoder.block.14.layer.0.SelfAttention.k.weight": "model-00002-of-00002.safetensors",
63
+ "encoder.block.14.layer.0.SelfAttention.o.weight": "model-00002-of-00002.safetensors",
64
+ "encoder.block.14.layer.0.SelfAttention.q.weight": "model-00002-of-00002.safetensors",
65
+ "encoder.block.14.layer.0.SelfAttention.v.weight": "model-00002-of-00002.safetensors",
66
+ "encoder.block.14.layer.0.layer_norm.weight": "model-00002-of-00002.safetensors",
67
+ "encoder.block.14.layer.1.DenseReluDense.wi_0.weight": "model-00002-of-00002.safetensors",
68
+ "encoder.block.14.layer.1.DenseReluDense.wi_1.weight": "model-00002-of-00002.safetensors",
69
+ "encoder.block.14.layer.1.DenseReluDense.wo.weight": "model-00002-of-00002.safetensors",
70
+ "encoder.block.14.layer.1.layer_norm.weight": "model-00002-of-00002.safetensors",
71
+ "encoder.block.15.layer.0.SelfAttention.k.weight": "model-00002-of-00002.safetensors",
72
+ "encoder.block.15.layer.0.SelfAttention.o.weight": "model-00002-of-00002.safetensors",
73
+ "encoder.block.15.layer.0.SelfAttention.q.weight": "model-00002-of-00002.safetensors",
74
+ "encoder.block.15.layer.0.SelfAttention.v.weight": "model-00002-of-00002.safetensors",
75
+ "encoder.block.15.layer.0.layer_norm.weight": "model-00002-of-00002.safetensors",
76
+ "encoder.block.15.layer.1.DenseReluDense.wi_0.weight": "model-00002-of-00002.safetensors",
77
+ "encoder.block.15.layer.1.DenseReluDense.wi_1.weight": "model-00002-of-00002.safetensors",
78
+ "encoder.block.15.layer.1.DenseReluDense.wo.weight": "model-00002-of-00002.safetensors",
79
+ "encoder.block.15.layer.1.layer_norm.weight": "model-00002-of-00002.safetensors",
80
+ "encoder.block.16.layer.0.SelfAttention.k.weight": "model-00002-of-00002.safetensors",
81
+ "encoder.block.16.layer.0.SelfAttention.o.weight": "model-00002-of-00002.safetensors",
82
+ "encoder.block.16.layer.0.SelfAttention.q.weight": "model-00002-of-00002.safetensors",
83
+ "encoder.block.16.layer.0.SelfAttention.v.weight": "model-00002-of-00002.safetensors",
84
+ "encoder.block.16.layer.0.layer_norm.weight": "model-00002-of-00002.safetensors",
85
+ "encoder.block.16.layer.1.DenseReluDense.wi_0.weight": "model-00002-of-00002.safetensors",
86
+ "encoder.block.16.layer.1.DenseReluDense.wi_1.weight": "model-00002-of-00002.safetensors",
87
+ "encoder.block.16.layer.1.DenseReluDense.wo.weight": "model-00002-of-00002.safetensors",
88
+ "encoder.block.16.layer.1.layer_norm.weight": "model-00002-of-00002.safetensors",
89
+ "encoder.block.17.layer.0.SelfAttention.k.weight": "model-00002-of-00002.safetensors",
90
+ "encoder.block.17.layer.0.SelfAttention.o.weight": "model-00002-of-00002.safetensors",
91
+ "encoder.block.17.layer.0.SelfAttention.q.weight": "model-00002-of-00002.safetensors",
92
+ "encoder.block.17.layer.0.SelfAttention.v.weight": "model-00002-of-00002.safetensors",
93
+ "encoder.block.17.layer.0.layer_norm.weight": "model-00002-of-00002.safetensors",
94
+ "encoder.block.17.layer.1.DenseReluDense.wi_0.weight": "model-00002-of-00002.safetensors",
95
+ "encoder.block.17.layer.1.DenseReluDense.wi_1.weight": "model-00002-of-00002.safetensors",
96
+ "encoder.block.17.layer.1.DenseReluDense.wo.weight": "model-00002-of-00002.safetensors",
97
+ "encoder.block.17.layer.1.layer_norm.weight": "model-00002-of-00002.safetensors",
98
+ "encoder.block.18.layer.0.SelfAttention.k.weight": "model-00002-of-00002.safetensors",
99
+ "encoder.block.18.layer.0.SelfAttention.o.weight": "model-00002-of-00002.safetensors",
100
+ "encoder.block.18.layer.0.SelfAttention.q.weight": "model-00002-of-00002.safetensors",
101
+ "encoder.block.18.layer.0.SelfAttention.v.weight": "model-00002-of-00002.safetensors",
102
+ "encoder.block.18.layer.0.layer_norm.weight": "model-00002-of-00002.safetensors",
103
+ "encoder.block.18.layer.1.DenseReluDense.wi_0.weight": "model-00002-of-00002.safetensors",
104
+ "encoder.block.18.layer.1.DenseReluDense.wi_1.weight": "model-00002-of-00002.safetensors",
105
+ "encoder.block.18.layer.1.DenseReluDense.wo.weight": "model-00002-of-00002.safetensors",
106
+ "encoder.block.18.layer.1.layer_norm.weight": "model-00002-of-00002.safetensors",
107
+ "encoder.block.19.layer.0.SelfAttention.k.weight": "model-00002-of-00002.safetensors",
108
+ "encoder.block.19.layer.0.SelfAttention.o.weight": "model-00002-of-00002.safetensors",
109
+ "encoder.block.19.layer.0.SelfAttention.q.weight": "model-00002-of-00002.safetensors",
110
+ "encoder.block.19.layer.0.SelfAttention.v.weight": "model-00002-of-00002.safetensors",
111
+ "encoder.block.19.layer.0.layer_norm.weight": "model-00002-of-00002.safetensors",
112
+ "encoder.block.19.layer.1.DenseReluDense.wi_0.weight": "model-00002-of-00002.safetensors",
113
+ "encoder.block.19.layer.1.DenseReluDense.wi_1.weight": "model-00002-of-00002.safetensors",
114
+ "encoder.block.19.layer.1.DenseReluDense.wo.weight": "model-00002-of-00002.safetensors",
115
+ "encoder.block.19.layer.1.layer_norm.weight": "model-00002-of-00002.safetensors",
116
+ "encoder.block.2.layer.0.SelfAttention.k.weight": "model-00001-of-00002.safetensors",
117
+ "encoder.block.2.layer.0.SelfAttention.o.weight": "model-00001-of-00002.safetensors",
118
+ "encoder.block.2.layer.0.SelfAttention.q.weight": "model-00001-of-00002.safetensors",
119
+ "encoder.block.2.layer.0.SelfAttention.v.weight": "model-00001-of-00002.safetensors",
120
+ "encoder.block.2.layer.0.layer_norm.weight": "model-00001-of-00002.safetensors",
121
+ "encoder.block.2.layer.1.DenseReluDense.wi_0.weight": "model-00001-of-00002.safetensors",
122
+ "encoder.block.2.layer.1.DenseReluDense.wi_1.weight": "model-00001-of-00002.safetensors",
123
+ "encoder.block.2.layer.1.DenseReluDense.wo.weight": "model-00001-of-00002.safetensors",
124
+ "encoder.block.2.layer.1.layer_norm.weight": "model-00001-of-00002.safetensors",
125
+ "encoder.block.20.layer.0.SelfAttention.k.weight": "model-00002-of-00002.safetensors",
126
+ "encoder.block.20.layer.0.SelfAttention.o.weight": "model-00002-of-00002.safetensors",
127
+ "encoder.block.20.layer.0.SelfAttention.q.weight": "model-00002-of-00002.safetensors",
128
+ "encoder.block.20.layer.0.SelfAttention.v.weight": "model-00002-of-00002.safetensors",
129
+ "encoder.block.20.layer.0.layer_norm.weight": "model-00002-of-00002.safetensors",
130
+ "encoder.block.20.layer.1.DenseReluDense.wi_0.weight": "model-00002-of-00002.safetensors",
131
+ "encoder.block.20.layer.1.DenseReluDense.wi_1.weight": "model-00002-of-00002.safetensors",
132
+ "encoder.block.20.layer.1.DenseReluDense.wo.weight": "model-00002-of-00002.safetensors",
133
+ "encoder.block.20.layer.1.layer_norm.weight": "model-00002-of-00002.safetensors",
134
+ "encoder.block.21.layer.0.SelfAttention.k.weight": "model-00002-of-00002.safetensors",
135
+ "encoder.block.21.layer.0.SelfAttention.o.weight": "model-00002-of-00002.safetensors",
136
+ "encoder.block.21.layer.0.SelfAttention.q.weight": "model-00002-of-00002.safetensors",
137
+ "encoder.block.21.layer.0.SelfAttention.v.weight": "model-00002-of-00002.safetensors",
138
+ "encoder.block.21.layer.0.layer_norm.weight": "model-00002-of-00002.safetensors",
139
+ "encoder.block.21.layer.1.DenseReluDense.wi_0.weight": "model-00002-of-00002.safetensors",
140
+ "encoder.block.21.layer.1.DenseReluDense.wi_1.weight": "model-00002-of-00002.safetensors",
141
+ "encoder.block.21.layer.1.DenseReluDense.wo.weight": "model-00002-of-00002.safetensors",
142
+ "encoder.block.21.layer.1.layer_norm.weight": "model-00002-of-00002.safetensors",
143
+ "encoder.block.22.layer.0.SelfAttention.k.weight": "model-00002-of-00002.safetensors",
144
+ "encoder.block.22.layer.0.SelfAttention.o.weight": "model-00002-of-00002.safetensors",
145
+ "encoder.block.22.layer.0.SelfAttention.q.weight": "model-00002-of-00002.safetensors",
146
+ "encoder.block.22.layer.0.SelfAttention.v.weight": "model-00002-of-00002.safetensors",
147
+ "encoder.block.22.layer.0.layer_norm.weight": "model-00002-of-00002.safetensors",
148
+ "encoder.block.22.layer.1.DenseReluDense.wi_0.weight": "model-00002-of-00002.safetensors",
149
+ "encoder.block.22.layer.1.DenseReluDense.wi_1.weight": "model-00002-of-00002.safetensors",
150
+ "encoder.block.22.layer.1.DenseReluDense.wo.weight": "model-00002-of-00002.safetensors",
151
+ "encoder.block.22.layer.1.layer_norm.weight": "model-00002-of-00002.safetensors",
152
+ "encoder.block.23.layer.0.SelfAttention.k.weight": "model-00002-of-00002.safetensors",
153
+ "encoder.block.23.layer.0.SelfAttention.o.weight": "model-00002-of-00002.safetensors",
154
+ "encoder.block.23.layer.0.SelfAttention.q.weight": "model-00002-of-00002.safetensors",
155
+ "encoder.block.23.layer.0.SelfAttention.v.weight": "model-00002-of-00002.safetensors",
156
+ "encoder.block.23.layer.0.layer_norm.weight": "model-00002-of-00002.safetensors",
157
+ "encoder.block.23.layer.1.DenseReluDense.wi_0.weight": "model-00002-of-00002.safetensors",
158
+ "encoder.block.23.layer.1.DenseReluDense.wi_1.weight": "model-00002-of-00002.safetensors",
159
+ "encoder.block.23.layer.1.DenseReluDense.wo.weight": "model-00002-of-00002.safetensors",
160
+ "encoder.block.23.layer.1.layer_norm.weight": "model-00002-of-00002.safetensors",
161
+ "encoder.block.3.layer.0.SelfAttention.k.weight": "model-00001-of-00002.safetensors",
162
+ "encoder.block.3.layer.0.SelfAttention.o.weight": "model-00001-of-00002.safetensors",
163
+ "encoder.block.3.layer.0.SelfAttention.q.weight": "model-00001-of-00002.safetensors",
164
+ "encoder.block.3.layer.0.SelfAttention.v.weight": "model-00001-of-00002.safetensors",
165
+ "encoder.block.3.layer.0.layer_norm.weight": "model-00001-of-00002.safetensors",
166
+ "encoder.block.3.layer.1.DenseReluDense.wi_0.weight": "model-00001-of-00002.safetensors",
167
+ "encoder.block.3.layer.1.DenseReluDense.wi_1.weight": "model-00001-of-00002.safetensors",
168
+ "encoder.block.3.layer.1.DenseReluDense.wo.weight": "model-00001-of-00002.safetensors",
169
+ "encoder.block.3.layer.1.layer_norm.weight": "model-00001-of-00002.safetensors",
170
+ "encoder.block.4.layer.0.SelfAttention.k.weight": "model-00001-of-00002.safetensors",
171
+ "encoder.block.4.layer.0.SelfAttention.o.weight": "model-00001-of-00002.safetensors",
172
+ "encoder.block.4.layer.0.SelfAttention.q.weight": "model-00001-of-00002.safetensors",
173
+ "encoder.block.4.layer.0.SelfAttention.v.weight": "model-00001-of-00002.safetensors",
174
+ "encoder.block.4.layer.0.layer_norm.weight": "model-00001-of-00002.safetensors",
175
+ "encoder.block.4.layer.1.DenseReluDense.wi_0.weight": "model-00001-of-00002.safetensors",
176
+ "encoder.block.4.layer.1.DenseReluDense.wi_1.weight": "model-00001-of-00002.safetensors",
177
+ "encoder.block.4.layer.1.DenseReluDense.wo.weight": "model-00001-of-00002.safetensors",
178
+ "encoder.block.4.layer.1.layer_norm.weight": "model-00001-of-00002.safetensors",
179
+ "encoder.block.5.layer.0.SelfAttention.k.weight": "model-00001-of-00002.safetensors",
180
+ "encoder.block.5.layer.0.SelfAttention.o.weight": "model-00001-of-00002.safetensors",
181
+ "encoder.block.5.layer.0.SelfAttention.q.weight": "model-00001-of-00002.safetensors",
182
+ "encoder.block.5.layer.0.SelfAttention.v.weight": "model-00001-of-00002.safetensors",
183
+ "encoder.block.5.layer.0.layer_norm.weight": "model-00001-of-00002.safetensors",
184
+ "encoder.block.5.layer.1.DenseReluDense.wi_0.weight": "model-00001-of-00002.safetensors",
185
+ "encoder.block.5.layer.1.DenseReluDense.wi_1.weight": "model-00001-of-00002.safetensors",
186
+ "encoder.block.5.layer.1.DenseReluDense.wo.weight": "model-00001-of-00002.safetensors",
187
+ "encoder.block.5.layer.1.layer_norm.weight": "model-00001-of-00002.safetensors",
188
+ "encoder.block.6.layer.0.SelfAttention.k.weight": "model-00001-of-00002.safetensors",
189
+ "encoder.block.6.layer.0.SelfAttention.o.weight": "model-00001-of-00002.safetensors",
190
+ "encoder.block.6.layer.0.SelfAttention.q.weight": "model-00001-of-00002.safetensors",
191
+ "encoder.block.6.layer.0.SelfAttention.v.weight": "model-00001-of-00002.safetensors",
192
+ "encoder.block.6.layer.0.layer_norm.weight": "model-00001-of-00002.safetensors",
193
+ "encoder.block.6.layer.1.DenseReluDense.wi_0.weight": "model-00001-of-00002.safetensors",
194
+ "encoder.block.6.layer.1.DenseReluDense.wi_1.weight": "model-00001-of-00002.safetensors",
195
+ "encoder.block.6.layer.1.DenseReluDense.wo.weight": "model-00001-of-00002.safetensors",
196
+ "encoder.block.6.layer.1.layer_norm.weight": "model-00001-of-00002.safetensors",
197
+ "encoder.block.7.layer.0.SelfAttention.k.weight": "model-00001-of-00002.safetensors",
198
+ "encoder.block.7.layer.0.SelfAttention.o.weight": "model-00001-of-00002.safetensors",
199
+ "encoder.block.7.layer.0.SelfAttention.q.weight": "model-00001-of-00002.safetensors",
200
+ "encoder.block.7.layer.0.SelfAttention.v.weight": "model-00001-of-00002.safetensors",
201
+ "encoder.block.7.layer.0.layer_norm.weight": "model-00001-of-00002.safetensors",
202
+ "encoder.block.7.layer.1.DenseReluDense.wi_0.weight": "model-00001-of-00002.safetensors",
203
+ "encoder.block.7.layer.1.DenseReluDense.wi_1.weight": "model-00001-of-00002.safetensors",
204
+ "encoder.block.7.layer.1.DenseReluDense.wo.weight": "model-00001-of-00002.safetensors",
205
+ "encoder.block.7.layer.1.layer_norm.weight": "model-00001-of-00002.safetensors",
206
+ "encoder.block.8.layer.0.SelfAttention.k.weight": "model-00001-of-00002.safetensors",
207
+ "encoder.block.8.layer.0.SelfAttention.o.weight": "model-00001-of-00002.safetensors",
208
+ "encoder.block.8.layer.0.SelfAttention.q.weight": "model-00001-of-00002.safetensors",
209
+ "encoder.block.8.layer.0.SelfAttention.v.weight": "model-00001-of-00002.safetensors",
210
+ "encoder.block.8.layer.0.layer_norm.weight": "model-00001-of-00002.safetensors",
211
+ "encoder.block.8.layer.1.DenseReluDense.wi_0.weight": "model-00001-of-00002.safetensors",
212
+ "encoder.block.8.layer.1.DenseReluDense.wi_1.weight": "model-00001-of-00002.safetensors",
213
+ "encoder.block.8.layer.1.DenseReluDense.wo.weight": "model-00001-of-00002.safetensors",
214
+ "encoder.block.8.layer.1.layer_norm.weight": "model-00001-of-00002.safetensors",
215
+ "encoder.block.9.layer.0.SelfAttention.k.weight": "model-00001-of-00002.safetensors",
216
+ "encoder.block.9.layer.0.SelfAttention.o.weight": "model-00001-of-00002.safetensors",
217
+ "encoder.block.9.layer.0.SelfAttention.q.weight": "model-00001-of-00002.safetensors",
218
+ "encoder.block.9.layer.0.SelfAttention.v.weight": "model-00001-of-00002.safetensors",
219
+ "encoder.block.9.layer.0.layer_norm.weight": "model-00001-of-00002.safetensors",
220
+ "encoder.block.9.layer.1.DenseReluDense.wi_0.weight": "model-00001-of-00002.safetensors",
221
+ "encoder.block.9.layer.1.DenseReluDense.wi_1.weight": "model-00001-of-00002.safetensors",
222
+ "encoder.block.9.layer.1.DenseReluDense.wo.weight": "model-00001-of-00002.safetensors",
223
+ "encoder.block.9.layer.1.layer_norm.weight": "model-00001-of-00002.safetensors",
224
+ "encoder.final_layer_norm.weight": "model-00002-of-00002.safetensors",
225
+ "shared.weight": "model-00001-of-00002.safetensors"
226
+ }
227
+ }
tokenizer/added_tokens.json ADDED
@@ -0,0 +1,102 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "<extra_id_0>": 32099,
3
+ "<extra_id_10>": 32089,
4
+ "<extra_id_11>": 32088,
5
+ "<extra_id_12>": 32087,
6
+ "<extra_id_13>": 32086,
7
+ "<extra_id_14>": 32085,
8
+ "<extra_id_15>": 32084,
9
+ "<extra_id_16>": 32083,
10
+ "<extra_id_17>": 32082,
11
+ "<extra_id_18>": 32081,
12
+ "<extra_id_19>": 32080,
13
+ "<extra_id_1>": 32098,
14
+ "<extra_id_20>": 32079,
15
+ "<extra_id_21>": 32078,
16
+ "<extra_id_22>": 32077,
17
+ "<extra_id_23>": 32076,
18
+ "<extra_id_24>": 32075,
19
+ "<extra_id_25>": 32074,
20
+ "<extra_id_26>": 32073,
21
+ "<extra_id_27>": 32072,
22
+ "<extra_id_28>": 32071,
23
+ "<extra_id_29>": 32070,
24
+ "<extra_id_2>": 32097,
25
+ "<extra_id_30>": 32069,
26
+ "<extra_id_31>": 32068,
27
+ "<extra_id_32>": 32067,
28
+ "<extra_id_33>": 32066,
29
+ "<extra_id_34>": 32065,
30
+ "<extra_id_35>": 32064,
31
+ "<extra_id_36>": 32063,
32
+ "<extra_id_37>": 32062,
33
+ "<extra_id_38>": 32061,
34
+ "<extra_id_39>": 32060,
35
+ "<extra_id_3>": 32096,
36
+ "<extra_id_40>": 32059,
37
+ "<extra_id_41>": 32058,
38
+ "<extra_id_42>": 32057,
39
+ "<extra_id_43>": 32056,
40
+ "<extra_id_44>": 32055,
41
+ "<extra_id_45>": 32054,
42
+ "<extra_id_46>": 32053,
43
+ "<extra_id_47>": 32052,
44
+ "<extra_id_48>": 32051,
45
+ "<extra_id_49>": 32050,
46
+ "<extra_id_4>": 32095,
47
+ "<extra_id_50>": 32049,
48
+ "<extra_id_51>": 32048,
49
+ "<extra_id_52>": 32047,
50
+ "<extra_id_53>": 32046,
51
+ "<extra_id_54>": 32045,
52
+ "<extra_id_55>": 32044,
53
+ "<extra_id_56>": 32043,
54
+ "<extra_id_57>": 32042,
55
+ "<extra_id_58>": 32041,
56
+ "<extra_id_59>": 32040,
57
+ "<extra_id_5>": 32094,
58
+ "<extra_id_60>": 32039,
59
+ "<extra_id_61>": 32038,
60
+ "<extra_id_62>": 32037,
61
+ "<extra_id_63>": 32036,
62
+ "<extra_id_64>": 32035,
63
+ "<extra_id_65>": 32034,
64
+ "<extra_id_66>": 32033,
65
+ "<extra_id_67>": 32032,
66
+ "<extra_id_68>": 32031,
67
+ "<extra_id_69>": 32030,
68
+ "<extra_id_6>": 32093,
69
+ "<extra_id_70>": 32029,
70
+ "<extra_id_71>": 32028,
71
+ "<extra_id_72>": 32027,
72
+ "<extra_id_73>": 32026,
73
+ "<extra_id_74>": 32025,
74
+ "<extra_id_75>": 32024,
75
+ "<extra_id_76>": 32023,
76
+ "<extra_id_77>": 32022,
77
+ "<extra_id_78>": 32021,
78
+ "<extra_id_79>": 32020,
79
+ "<extra_id_7>": 32092,
80
+ "<extra_id_80>": 32019,
81
+ "<extra_id_81>": 32018,
82
+ "<extra_id_82>": 32017,
83
+ "<extra_id_83>": 32016,
84
+ "<extra_id_84>": 32015,
85
+ "<extra_id_85>": 32014,
86
+ "<extra_id_86>": 32013,
87
+ "<extra_id_87>": 32012,
88
+ "<extra_id_88>": 32011,
89
+ "<extra_id_89>": 32010,
90
+ "<extra_id_8>": 32091,
91
+ "<extra_id_90>": 32009,
92
+ "<extra_id_91>": 32008,
93
+ "<extra_id_92>": 32007,
94
+ "<extra_id_93>": 32006,
95
+ "<extra_id_94>": 32005,
96
+ "<extra_id_95>": 32004,
97
+ "<extra_id_96>": 32003,
98
+ "<extra_id_97>": 32002,
99
+ "<extra_id_98>": 32001,
100
+ "<extra_id_99>": 32000,
101
+ "<extra_id_9>": 32090
102
+ }
tokenizer/special_tokens_map.json ADDED
@@ -0,0 +1,125 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "additional_special_tokens": [
3
+ "<extra_id_0>",
4
+ "<extra_id_1>",
5
+ "<extra_id_2>",
6
+ "<extra_id_3>",
7
+ "<extra_id_4>",
8
+ "<extra_id_5>",
9
+ "<extra_id_6>",
10
+ "<extra_id_7>",
11
+ "<extra_id_8>",
12
+ "<extra_id_9>",
13
+ "<extra_id_10>",
14
+ "<extra_id_11>",
15
+ "<extra_id_12>",
16
+ "<extra_id_13>",
17
+ "<extra_id_14>",
18
+ "<extra_id_15>",
19
+ "<extra_id_16>",
20
+ "<extra_id_17>",
21
+ "<extra_id_18>",
22
+ "<extra_id_19>",
23
+ "<extra_id_20>",
24
+ "<extra_id_21>",
25
+ "<extra_id_22>",
26
+ "<extra_id_23>",
27
+ "<extra_id_24>",
28
+ "<extra_id_25>",
29
+ "<extra_id_26>",
30
+ "<extra_id_27>",
31
+ "<extra_id_28>",
32
+ "<extra_id_29>",
33
+ "<extra_id_30>",
34
+ "<extra_id_31>",
35
+ "<extra_id_32>",
36
+ "<extra_id_33>",
37
+ "<extra_id_34>",
38
+ "<extra_id_35>",
39
+ "<extra_id_36>",
40
+ "<extra_id_37>",
41
+ "<extra_id_38>",
42
+ "<extra_id_39>",
43
+ "<extra_id_40>",
44
+ "<extra_id_41>",
45
+ "<extra_id_42>",
46
+ "<extra_id_43>",
47
+ "<extra_id_44>",
48
+ "<extra_id_45>",
49
+ "<extra_id_46>",
50
+ "<extra_id_47>",
51
+ "<extra_id_48>",
52
+ "<extra_id_49>",
53
+ "<extra_id_50>",
54
+ "<extra_id_51>",
55
+ "<extra_id_52>",
56
+ "<extra_id_53>",
57
+ "<extra_id_54>",
58
+ "<extra_id_55>",
59
+ "<extra_id_56>",
60
+ "<extra_id_57>",
61
+ "<extra_id_58>",
62
+ "<extra_id_59>",
63
+ "<extra_id_60>",
64
+ "<extra_id_61>",
65
+ "<extra_id_62>",
66
+ "<extra_id_63>",
67
+ "<extra_id_64>",
68
+ "<extra_id_65>",
69
+ "<extra_id_66>",
70
+ "<extra_id_67>",
71
+ "<extra_id_68>",
72
+ "<extra_id_69>",
73
+ "<extra_id_70>",
74
+ "<extra_id_71>",
75
+ "<extra_id_72>",
76
+ "<extra_id_73>",
77
+ "<extra_id_74>",
78
+ "<extra_id_75>",
79
+ "<extra_id_76>",
80
+ "<extra_id_77>",
81
+ "<extra_id_78>",
82
+ "<extra_id_79>",
83
+ "<extra_id_80>",
84
+ "<extra_id_81>",
85
+ "<extra_id_82>",
86
+ "<extra_id_83>",
87
+ "<extra_id_84>",
88
+ "<extra_id_85>",
89
+ "<extra_id_86>",
90
+ "<extra_id_87>",
91
+ "<extra_id_88>",
92
+ "<extra_id_89>",
93
+ "<extra_id_90>",
94
+ "<extra_id_91>",
95
+ "<extra_id_92>",
96
+ "<extra_id_93>",
97
+ "<extra_id_94>",
98
+ "<extra_id_95>",
99
+ "<extra_id_96>",
100
+ "<extra_id_97>",
101
+ "<extra_id_98>",
102
+ "<extra_id_99>"
103
+ ],
104
+ "eos_token": {
105
+ "content": "</s>",
106
+ "lstrip": false,
107
+ "normalized": false,
108
+ "rstrip": false,
109
+ "single_word": false
110
+ },
111
+ "pad_token": {
112
+ "content": "<pad>",
113
+ "lstrip": false,
114
+ "normalized": false,
115
+ "rstrip": false,
116
+ "single_word": false
117
+ },
118
+ "unk_token": {
119
+ "content": "<unk>",
120
+ "lstrip": false,
121
+ "normalized": false,
122
+ "rstrip": false,
123
+ "single_word": false
124
+ }
125
+ }
tokenizer/spiece.model ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d60acb128cf7b7f2536e8f38a5b18a05535c9e14c7a355904270e15b0945ea86
3
+ size 791656
tokenizer/tokenizer_config.json ADDED
@@ -0,0 +1,941 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "add_prefix_space": true,
3
+ "added_tokens_decoder": {
4
+ "0": {
5
+ "content": "<pad>",
6
+ "lstrip": false,
7
+ "normalized": false,
8
+ "rstrip": false,
9
+ "single_word": false,
10
+ "special": true
11
+ },
12
+ "1": {
13
+ "content": "</s>",
14
+ "lstrip": false,
15
+ "normalized": false,
16
+ "rstrip": false,
17
+ "single_word": false,
18
+ "special": true
19
+ },
20
+ "2": {
21
+ "content": "<unk>",
22
+ "lstrip": false,
23
+ "normalized": false,
24
+ "rstrip": false,
25
+ "single_word": false,
26
+ "special": true
27
+ },
28
+ "32000": {
29
+ "content": "<extra_id_99>",
30
+ "lstrip": false,
31
+ "normalized": false,
32
+ "rstrip": false,
33
+ "single_word": false,
34
+ "special": true
35
+ },
36
+ "32001": {
37
+ "content": "<extra_id_98>",
38
+ "lstrip": false,
39
+ "normalized": false,
40
+ "rstrip": false,
41
+ "single_word": false,
42
+ "special": true
43
+ },
44
+ "32002": {
45
+ "content": "<extra_id_97>",
46
+ "lstrip": false,
47
+ "normalized": false,
48
+ "rstrip": false,
49
+ "single_word": false,
50
+ "special": true
51
+ },
52
+ "32003": {
53
+ "content": "<extra_id_96>",
54
+ "lstrip": false,
55
+ "normalized": false,
56
+ "rstrip": false,
57
+ "single_word": false,
58
+ "special": true
59
+ },
60
+ "32004": {
61
+ "content": "<extra_id_95>",
62
+ "lstrip": false,
63
+ "normalized": false,
64
+ "rstrip": false,
65
+ "single_word": false,
66
+ "special": true
67
+ },
68
+ "32005": {
69
+ "content": "<extra_id_94>",
70
+ "lstrip": false,
71
+ "normalized": false,
72
+ "rstrip": false,
73
+ "single_word": false,
74
+ "special": true
75
+ },
76
+ "32006": {
77
+ "content": "<extra_id_93>",
78
+ "lstrip": false,
79
+ "normalized": false,
80
+ "rstrip": false,
81
+ "single_word": false,
82
+ "special": true
83
+ },
84
+ "32007": {
85
+ "content": "<extra_id_92>",
86
+ "lstrip": false,
87
+ "normalized": false,
88
+ "rstrip": false,
89
+ "single_word": false,
90
+ "special": true
91
+ },
92
+ "32008": {
93
+ "content": "<extra_id_91>",
94
+ "lstrip": false,
95
+ "normalized": false,
96
+ "rstrip": false,
97
+ "single_word": false,
98
+ "special": true
99
+ },
100
+ "32009": {
101
+ "content": "<extra_id_90>",
102
+ "lstrip": false,
103
+ "normalized": false,
104
+ "rstrip": false,
105
+ "single_word": false,
106
+ "special": true
107
+ },
108
+ "32010": {
109
+ "content": "<extra_id_89>",
110
+ "lstrip": false,
111
+ "normalized": false,
112
+ "rstrip": false,
113
+ "single_word": false,
114
+ "special": true
115
+ },
116
+ "32011": {
117
+ "content": "<extra_id_88>",
118
+ "lstrip": false,
119
+ "normalized": false,
120
+ "rstrip": false,
121
+ "single_word": false,
122
+ "special": true
123
+ },
124
+ "32012": {
125
+ "content": "<extra_id_87>",
126
+ "lstrip": false,
127
+ "normalized": false,
128
+ "rstrip": false,
129
+ "single_word": false,
130
+ "special": true
131
+ },
132
+ "32013": {
133
+ "content": "<extra_id_86>",
134
+ "lstrip": false,
135
+ "normalized": false,
136
+ "rstrip": false,
137
+ "single_word": false,
138
+ "special": true
139
+ },
140
+ "32014": {
141
+ "content": "<extra_id_85>",
142
+ "lstrip": false,
143
+ "normalized": false,
144
+ "rstrip": false,
145
+ "single_word": false,
146
+ "special": true
147
+ },
148
+ "32015": {
149
+ "content": "<extra_id_84>",
150
+ "lstrip": false,
151
+ "normalized": false,
152
+ "rstrip": false,
153
+ "single_word": false,
154
+ "special": true
155
+ },
156
+ "32016": {
157
+ "content": "<extra_id_83>",
158
+ "lstrip": false,
159
+ "normalized": false,
160
+ "rstrip": false,
161
+ "single_word": false,
162
+ "special": true
163
+ },
164
+ "32017": {
165
+ "content": "<extra_id_82>",
166
+ "lstrip": false,
167
+ "normalized": false,
168
+ "rstrip": false,
169
+ "single_word": false,
170
+ "special": true
171
+ },
172
+ "32018": {
173
+ "content": "<extra_id_81>",
174
+ "lstrip": false,
175
+ "normalized": false,
176
+ "rstrip": false,
177
+ "single_word": false,
178
+ "special": true
179
+ },
180
+ "32019": {
181
+ "content": "<extra_id_80>",
182
+ "lstrip": false,
183
+ "normalized": false,
184
+ "rstrip": false,
185
+ "single_word": false,
186
+ "special": true
187
+ },
188
+ "32020": {
189
+ "content": "<extra_id_79>",
190
+ "lstrip": false,
191
+ "normalized": false,
192
+ "rstrip": false,
193
+ "single_word": false,
194
+ "special": true
195
+ },
196
+ "32021": {
197
+ "content": "<extra_id_78>",
198
+ "lstrip": false,
199
+ "normalized": false,
200
+ "rstrip": false,
201
+ "single_word": false,
202
+ "special": true
203
+ },
204
+ "32022": {
205
+ "content": "<extra_id_77>",
206
+ "lstrip": false,
207
+ "normalized": false,
208
+ "rstrip": false,
209
+ "single_word": false,
210
+ "special": true
211
+ },
212
+ "32023": {
213
+ "content": "<extra_id_76>",
214
+ "lstrip": false,
215
+ "normalized": false,
216
+ "rstrip": false,
217
+ "single_word": false,
218
+ "special": true
219
+ },
220
+ "32024": {
221
+ "content": "<extra_id_75>",
222
+ "lstrip": false,
223
+ "normalized": false,
224
+ "rstrip": false,
225
+ "single_word": false,
226
+ "special": true
227
+ },
228
+ "32025": {
229
+ "content": "<extra_id_74>",
230
+ "lstrip": false,
231
+ "normalized": false,
232
+ "rstrip": false,
233
+ "single_word": false,
234
+ "special": true
235
+ },
236
+ "32026": {
237
+ "content": "<extra_id_73>",
238
+ "lstrip": false,
239
+ "normalized": false,
240
+ "rstrip": false,
241
+ "single_word": false,
242
+ "special": true
243
+ },
244
+ "32027": {
245
+ "content": "<extra_id_72>",
246
+ "lstrip": false,
247
+ "normalized": false,
248
+ "rstrip": false,
249
+ "single_word": false,
250
+ "special": true
251
+ },
252
+ "32028": {
253
+ "content": "<extra_id_71>",
254
+ "lstrip": false,
255
+ "normalized": false,
256
+ "rstrip": false,
257
+ "single_word": false,
258
+ "special": true
259
+ },
260
+ "32029": {
261
+ "content": "<extra_id_70>",
262
+ "lstrip": false,
263
+ "normalized": false,
264
+ "rstrip": false,
265
+ "single_word": false,
266
+ "special": true
267
+ },
268
+ "32030": {
269
+ "content": "<extra_id_69>",
270
+ "lstrip": false,
271
+ "normalized": false,
272
+ "rstrip": false,
273
+ "single_word": false,
274
+ "special": true
275
+ },
276
+ "32031": {
277
+ "content": "<extra_id_68>",
278
+ "lstrip": false,
279
+ "normalized": false,
280
+ "rstrip": false,
281
+ "single_word": false,
282
+ "special": true
283
+ },
284
+ "32032": {
285
+ "content": "<extra_id_67>",
286
+ "lstrip": false,
287
+ "normalized": false,
288
+ "rstrip": false,
289
+ "single_word": false,
290
+ "special": true
291
+ },
292
+ "32033": {
293
+ "content": "<extra_id_66>",
294
+ "lstrip": false,
295
+ "normalized": false,
296
+ "rstrip": false,
297
+ "single_word": false,
298
+ "special": true
299
+ },
300
+ "32034": {
301
+ "content": "<extra_id_65>",
302
+ "lstrip": false,
303
+ "normalized": false,
304
+ "rstrip": false,
305
+ "single_word": false,
306
+ "special": true
307
+ },
308
+ "32035": {
309
+ "content": "<extra_id_64>",
310
+ "lstrip": false,
311
+ "normalized": false,
312
+ "rstrip": false,
313
+ "single_word": false,
314
+ "special": true
315
+ },
316
+ "32036": {
317
+ "content": "<extra_id_63>",
318
+ "lstrip": false,
319
+ "normalized": false,
320
+ "rstrip": false,
321
+ "single_word": false,
322
+ "special": true
323
+ },
324
+ "32037": {
325
+ "content": "<extra_id_62>",
326
+ "lstrip": false,
327
+ "normalized": false,
328
+ "rstrip": false,
329
+ "single_word": false,
330
+ "special": true
331
+ },
332
+ "32038": {
333
+ "content": "<extra_id_61>",
334
+ "lstrip": false,
335
+ "normalized": false,
336
+ "rstrip": false,
337
+ "single_word": false,
338
+ "special": true
339
+ },
340
+ "32039": {
341
+ "content": "<extra_id_60>",
342
+ "lstrip": false,
343
+ "normalized": false,
344
+ "rstrip": false,
345
+ "single_word": false,
346
+ "special": true
347
+ },
348
+ "32040": {
349
+ "content": "<extra_id_59>",
350
+ "lstrip": false,
351
+ "normalized": false,
352
+ "rstrip": false,
353
+ "single_word": false,
354
+ "special": true
355
+ },
356
+ "32041": {
357
+ "content": "<extra_id_58>",
358
+ "lstrip": false,
359
+ "normalized": false,
360
+ "rstrip": false,
361
+ "single_word": false,
362
+ "special": true
363
+ },
364
+ "32042": {
365
+ "content": "<extra_id_57>",
366
+ "lstrip": false,
367
+ "normalized": false,
368
+ "rstrip": false,
369
+ "single_word": false,
370
+ "special": true
371
+ },
372
+ "32043": {
373
+ "content": "<extra_id_56>",
374
+ "lstrip": false,
375
+ "normalized": false,
376
+ "rstrip": false,
377
+ "single_word": false,
378
+ "special": true
379
+ },
380
+ "32044": {
381
+ "content": "<extra_id_55>",
382
+ "lstrip": false,
383
+ "normalized": false,
384
+ "rstrip": false,
385
+ "single_word": false,
386
+ "special": true
387
+ },
388
+ "32045": {
389
+ "content": "<extra_id_54>",
390
+ "lstrip": false,
391
+ "normalized": false,
392
+ "rstrip": false,
393
+ "single_word": false,
394
+ "special": true
395
+ },
396
+ "32046": {
397
+ "content": "<extra_id_53>",
398
+ "lstrip": false,
399
+ "normalized": false,
400
+ "rstrip": false,
401
+ "single_word": false,
402
+ "special": true
403
+ },
404
+ "32047": {
405
+ "content": "<extra_id_52>",
406
+ "lstrip": false,
407
+ "normalized": false,
408
+ "rstrip": false,
409
+ "single_word": false,
410
+ "special": true
411
+ },
412
+ "32048": {
413
+ "content": "<extra_id_51>",
414
+ "lstrip": false,
415
+ "normalized": false,
416
+ "rstrip": false,
417
+ "single_word": false,
418
+ "special": true
419
+ },
420
+ "32049": {
421
+ "content": "<extra_id_50>",
422
+ "lstrip": false,
423
+ "normalized": false,
424
+ "rstrip": false,
425
+ "single_word": false,
426
+ "special": true
427
+ },
428
+ "32050": {
429
+ "content": "<extra_id_49>",
430
+ "lstrip": false,
431
+ "normalized": false,
432
+ "rstrip": false,
433
+ "single_word": false,
434
+ "special": true
435
+ },
436
+ "32051": {
437
+ "content": "<extra_id_48>",
438
+ "lstrip": false,
439
+ "normalized": false,
440
+ "rstrip": false,
441
+ "single_word": false,
442
+ "special": true
443
+ },
444
+ "32052": {
445
+ "content": "<extra_id_47>",
446
+ "lstrip": false,
447
+ "normalized": false,
448
+ "rstrip": false,
449
+ "single_word": false,
450
+ "special": true
451
+ },
452
+ "32053": {
453
+ "content": "<extra_id_46>",
454
+ "lstrip": false,
455
+ "normalized": false,
456
+ "rstrip": false,
457
+ "single_word": false,
458
+ "special": true
459
+ },
460
+ "32054": {
461
+ "content": "<extra_id_45>",
462
+ "lstrip": false,
463
+ "normalized": false,
464
+ "rstrip": false,
465
+ "single_word": false,
466
+ "special": true
467
+ },
468
+ "32055": {
469
+ "content": "<extra_id_44>",
470
+ "lstrip": false,
471
+ "normalized": false,
472
+ "rstrip": false,
473
+ "single_word": false,
474
+ "special": true
475
+ },
476
+ "32056": {
477
+ "content": "<extra_id_43>",
478
+ "lstrip": false,
479
+ "normalized": false,
480
+ "rstrip": false,
481
+ "single_word": false,
482
+ "special": true
483
+ },
484
+ "32057": {
485
+ "content": "<extra_id_42>",
486
+ "lstrip": false,
487
+ "normalized": false,
488
+ "rstrip": false,
489
+ "single_word": false,
490
+ "special": true
491
+ },
492
+ "32058": {
493
+ "content": "<extra_id_41>",
494
+ "lstrip": false,
495
+ "normalized": false,
496
+ "rstrip": false,
497
+ "single_word": false,
498
+ "special": true
499
+ },
500
+ "32059": {
501
+ "content": "<extra_id_40>",
502
+ "lstrip": false,
503
+ "normalized": false,
504
+ "rstrip": false,
505
+ "single_word": false,
506
+ "special": true
507
+ },
508
+ "32060": {
509
+ "content": "<extra_id_39>",
510
+ "lstrip": false,
511
+ "normalized": false,
512
+ "rstrip": false,
513
+ "single_word": false,
514
+ "special": true
515
+ },
516
+ "32061": {
517
+ "content": "<extra_id_38>",
518
+ "lstrip": false,
519
+ "normalized": false,
520
+ "rstrip": false,
521
+ "single_word": false,
522
+ "special": true
523
+ },
524
+ "32062": {
525
+ "content": "<extra_id_37>",
526
+ "lstrip": false,
527
+ "normalized": false,
528
+ "rstrip": false,
529
+ "single_word": false,
530
+ "special": true
531
+ },
532
+ "32063": {
533
+ "content": "<extra_id_36>",
534
+ "lstrip": false,
535
+ "normalized": false,
536
+ "rstrip": false,
537
+ "single_word": false,
538
+ "special": true
539
+ },
540
+ "32064": {
541
+ "content": "<extra_id_35>",
542
+ "lstrip": false,
543
+ "normalized": false,
544
+ "rstrip": false,
545
+ "single_word": false,
546
+ "special": true
547
+ },
548
+ "32065": {
549
+ "content": "<extra_id_34>",
550
+ "lstrip": false,
551
+ "normalized": false,
552
+ "rstrip": false,
553
+ "single_word": false,
554
+ "special": true
555
+ },
556
+ "32066": {
557
+ "content": "<extra_id_33>",
558
+ "lstrip": false,
559
+ "normalized": false,
560
+ "rstrip": false,
561
+ "single_word": false,
562
+ "special": true
563
+ },
564
+ "32067": {
565
+ "content": "<extra_id_32>",
566
+ "lstrip": false,
567
+ "normalized": false,
568
+ "rstrip": false,
569
+ "single_word": false,
570
+ "special": true
571
+ },
572
+ "32068": {
573
+ "content": "<extra_id_31>",
574
+ "lstrip": false,
575
+ "normalized": false,
576
+ "rstrip": false,
577
+ "single_word": false,
578
+ "special": true
579
+ },
580
+ "32069": {
581
+ "content": "<extra_id_30>",
582
+ "lstrip": false,
583
+ "normalized": false,
584
+ "rstrip": false,
585
+ "single_word": false,
586
+ "special": true
587
+ },
588
+ "32070": {
589
+ "content": "<extra_id_29>",
590
+ "lstrip": false,
591
+ "normalized": false,
592
+ "rstrip": false,
593
+ "single_word": false,
594
+ "special": true
595
+ },
596
+ "32071": {
597
+ "content": "<extra_id_28>",
598
+ "lstrip": false,
599
+ "normalized": false,
600
+ "rstrip": false,
601
+ "single_word": false,
602
+ "special": true
603
+ },
604
+ "32072": {
605
+ "content": "<extra_id_27>",
606
+ "lstrip": false,
607
+ "normalized": false,
608
+ "rstrip": false,
609
+ "single_word": false,
610
+ "special": true
611
+ },
612
+ "32073": {
613
+ "content": "<extra_id_26>",
614
+ "lstrip": false,
615
+ "normalized": false,
616
+ "rstrip": false,
617
+ "single_word": false,
618
+ "special": true
619
+ },
620
+ "32074": {
621
+ "content": "<extra_id_25>",
622
+ "lstrip": false,
623
+ "normalized": false,
624
+ "rstrip": false,
625
+ "single_word": false,
626
+ "special": true
627
+ },
628
+ "32075": {
629
+ "content": "<extra_id_24>",
630
+ "lstrip": false,
631
+ "normalized": false,
632
+ "rstrip": false,
633
+ "single_word": false,
634
+ "special": true
635
+ },
636
+ "32076": {
637
+ "content": "<extra_id_23>",
638
+ "lstrip": false,
639
+ "normalized": false,
640
+ "rstrip": false,
641
+ "single_word": false,
642
+ "special": true
643
+ },
644
+ "32077": {
645
+ "content": "<extra_id_22>",
646
+ "lstrip": false,
647
+ "normalized": false,
648
+ "rstrip": false,
649
+ "single_word": false,
650
+ "special": true
651
+ },
652
+ "32078": {
653
+ "content": "<extra_id_21>",
654
+ "lstrip": false,
655
+ "normalized": false,
656
+ "rstrip": false,
657
+ "single_word": false,
658
+ "special": true
659
+ },
660
+ "32079": {
661
+ "content": "<extra_id_20>",
662
+ "lstrip": false,
663
+ "normalized": false,
664
+ "rstrip": false,
665
+ "single_word": false,
666
+ "special": true
667
+ },
668
+ "32080": {
669
+ "content": "<extra_id_19>",
670
+ "lstrip": false,
671
+ "normalized": false,
672
+ "rstrip": false,
673
+ "single_word": false,
674
+ "special": true
675
+ },
676
+ "32081": {
677
+ "content": "<extra_id_18>",
678
+ "lstrip": false,
679
+ "normalized": false,
680
+ "rstrip": false,
681
+ "single_word": false,
682
+ "special": true
683
+ },
684
+ "32082": {
685
+ "content": "<extra_id_17>",
686
+ "lstrip": false,
687
+ "normalized": false,
688
+ "rstrip": false,
689
+ "single_word": false,
690
+ "special": true
691
+ },
692
+ "32083": {
693
+ "content": "<extra_id_16>",
694
+ "lstrip": false,
695
+ "normalized": false,
696
+ "rstrip": false,
697
+ "single_word": false,
698
+ "special": true
699
+ },
700
+ "32084": {
701
+ "content": "<extra_id_15>",
702
+ "lstrip": false,
703
+ "normalized": false,
704
+ "rstrip": false,
705
+ "single_word": false,
706
+ "special": true
707
+ },
708
+ "32085": {
709
+ "content": "<extra_id_14>",
710
+ "lstrip": false,
711
+ "normalized": false,
712
+ "rstrip": false,
713
+ "single_word": false,
714
+ "special": true
715
+ },
716
+ "32086": {
717
+ "content": "<extra_id_13>",
718
+ "lstrip": false,
719
+ "normalized": false,
720
+ "rstrip": false,
721
+ "single_word": false,
722
+ "special": true
723
+ },
724
+ "32087": {
725
+ "content": "<extra_id_12>",
726
+ "lstrip": false,
727
+ "normalized": false,
728
+ "rstrip": false,
729
+ "single_word": false,
730
+ "special": true
731
+ },
732
+ "32088": {
733
+ "content": "<extra_id_11>",
734
+ "lstrip": false,
735
+ "normalized": false,
736
+ "rstrip": false,
737
+ "single_word": false,
738
+ "special": true
739
+ },
740
+ "32089": {
741
+ "content": "<extra_id_10>",
742
+ "lstrip": false,
743
+ "normalized": false,
744
+ "rstrip": false,
745
+ "single_word": false,
746
+ "special": true
747
+ },
748
+ "32090": {
749
+ "content": "<extra_id_9>",
750
+ "lstrip": false,
751
+ "normalized": false,
752
+ "rstrip": false,
753
+ "single_word": false,
754
+ "special": true
755
+ },
756
+ "32091": {
757
+ "content": "<extra_id_8>",
758
+ "lstrip": false,
759
+ "normalized": false,
760
+ "rstrip": false,
761
+ "single_word": false,
762
+ "special": true
763
+ },
764
+ "32092": {
765
+ "content": "<extra_id_7>",
766
+ "lstrip": false,
767
+ "normalized": false,
768
+ "rstrip": false,
769
+ "single_word": false,
770
+ "special": true
771
+ },
772
+ "32093": {
773
+ "content": "<extra_id_6>",
774
+ "lstrip": false,
775
+ "normalized": false,
776
+ "rstrip": false,
777
+ "single_word": false,
778
+ "special": true
779
+ },
780
+ "32094": {
781
+ "content": "<extra_id_5>",
782
+ "lstrip": false,
783
+ "normalized": false,
784
+ "rstrip": false,
785
+ "single_word": false,
786
+ "special": true
787
+ },
788
+ "32095": {
789
+ "content": "<extra_id_4>",
790
+ "lstrip": false,
791
+ "normalized": false,
792
+ "rstrip": false,
793
+ "single_word": false,
794
+ "special": true
795
+ },
796
+ "32096": {
797
+ "content": "<extra_id_3>",
798
+ "lstrip": false,
799
+ "normalized": false,
800
+ "rstrip": false,
801
+ "single_word": false,
802
+ "special": true
803
+ },
804
+ "32097": {
805
+ "content": "<extra_id_2>",
806
+ "lstrip": false,
807
+ "normalized": false,
808
+ "rstrip": false,
809
+ "single_word": false,
810
+ "special": true
811
+ },
812
+ "32098": {
813
+ "content": "<extra_id_1>",
814
+ "lstrip": false,
815
+ "normalized": false,
816
+ "rstrip": false,
817
+ "single_word": false,
818
+ "special": true
819
+ },
820
+ "32099": {
821
+ "content": "<extra_id_0>",
822
+ "lstrip": false,
823
+ "normalized": false,
824
+ "rstrip": false,
825
+ "single_word": false,
826
+ "special": true
827
+ }
828
+ },
829
+ "additional_special_tokens": [
830
+ "<extra_id_0>",
831
+ "<extra_id_1>",
832
+ "<extra_id_2>",
833
+ "<extra_id_3>",
834
+ "<extra_id_4>",
835
+ "<extra_id_5>",
836
+ "<extra_id_6>",
837
+ "<extra_id_7>",
838
+ "<extra_id_8>",
839
+ "<extra_id_9>",
840
+ "<extra_id_10>",
841
+ "<extra_id_11>",
842
+ "<extra_id_12>",
843
+ "<extra_id_13>",
844
+ "<extra_id_14>",
845
+ "<extra_id_15>",
846
+ "<extra_id_16>",
847
+ "<extra_id_17>",
848
+ "<extra_id_18>",
849
+ "<extra_id_19>",
850
+ "<extra_id_20>",
851
+ "<extra_id_21>",
852
+ "<extra_id_22>",
853
+ "<extra_id_23>",
854
+ "<extra_id_24>",
855
+ "<extra_id_25>",
856
+ "<extra_id_26>",
857
+ "<extra_id_27>",
858
+ "<extra_id_28>",
859
+ "<extra_id_29>",
860
+ "<extra_id_30>",
861
+ "<extra_id_31>",
862
+ "<extra_id_32>",
863
+ "<extra_id_33>",
864
+ "<extra_id_34>",
865
+ "<extra_id_35>",
866
+ "<extra_id_36>",
867
+ "<extra_id_37>",
868
+ "<extra_id_38>",
869
+ "<extra_id_39>",
870
+ "<extra_id_40>",
871
+ "<extra_id_41>",
872
+ "<extra_id_42>",
873
+ "<extra_id_43>",
874
+ "<extra_id_44>",
875
+ "<extra_id_45>",
876
+ "<extra_id_46>",
877
+ "<extra_id_47>",
878
+ "<extra_id_48>",
879
+ "<extra_id_49>",
880
+ "<extra_id_50>",
881
+ "<extra_id_51>",
882
+ "<extra_id_52>",
883
+ "<extra_id_53>",
884
+ "<extra_id_54>",
885
+ "<extra_id_55>",
886
+ "<extra_id_56>",
887
+ "<extra_id_57>",
888
+ "<extra_id_58>",
889
+ "<extra_id_59>",
890
+ "<extra_id_60>",
891
+ "<extra_id_61>",
892
+ "<extra_id_62>",
893
+ "<extra_id_63>",
894
+ "<extra_id_64>",
895
+ "<extra_id_65>",
896
+ "<extra_id_66>",
897
+ "<extra_id_67>",
898
+ "<extra_id_68>",
899
+ "<extra_id_69>",
900
+ "<extra_id_70>",
901
+ "<extra_id_71>",
902
+ "<extra_id_72>",
903
+ "<extra_id_73>",
904
+ "<extra_id_74>",
905
+ "<extra_id_75>",
906
+ "<extra_id_76>",
907
+ "<extra_id_77>",
908
+ "<extra_id_78>",
909
+ "<extra_id_79>",
910
+ "<extra_id_80>",
911
+ "<extra_id_81>",
912
+ "<extra_id_82>",
913
+ "<extra_id_83>",
914
+ "<extra_id_84>",
915
+ "<extra_id_85>",
916
+ "<extra_id_86>",
917
+ "<extra_id_87>",
918
+ "<extra_id_88>",
919
+ "<extra_id_89>",
920
+ "<extra_id_90>",
921
+ "<extra_id_91>",
922
+ "<extra_id_92>",
923
+ "<extra_id_93>",
924
+ "<extra_id_94>",
925
+ "<extra_id_95>",
926
+ "<extra_id_96>",
927
+ "<extra_id_97>",
928
+ "<extra_id_98>",
929
+ "<extra_id_99>"
930
+ ],
931
+ "clean_up_tokenization_spaces": true,
932
+ "eos_token": "</s>",
933
+ "extra_ids": 100,
934
+ "extra_special_tokens": {},
935
+ "legacy": true,
936
+ "model_max_length": 512,
937
+ "pad_token": "<pad>",
938
+ "sp_model_kwargs": {},
939
+ "tokenizer_class": "T5Tokenizer",
940
+ "unk_token": "<unk>"
941
+ }
transformer/config.json ADDED
@@ -0,0 +1,22 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_class_name": "ChromaTransformer2DModel",
3
+ "_diffusers_version": "0.35.1",
4
+ "approximator_hidden_dim": 5120,
5
+ "approximator_layers": 5,
6
+ "approximator_num_channels": 64,
7
+ "attention_head_dim": 128,
8
+ "axes_dims_rope": [
9
+ 16,
10
+ 56,
11
+ 56
12
+ ],
13
+ "guidance_embeds": false,
14
+ "in_channels": 64,
15
+ "joint_attention_dim": 4096,
16
+ "num_attention_heads": 24,
17
+ "num_layers": 19,
18
+ "num_single_layers": 38,
19
+ "out_channels": null,
20
+ "patch_size": 1,
21
+ "pooled_projection_dim": 768
22
+ }
transformer/diffusion_pytorch_model-00001-of-00002.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:59f0b26eccaabb8301e4166e653f1bcdebd7c46a4a07b02fe33d7a2c46d78eba
3
+ size 9946193392
transformer/diffusion_pytorch_model-00002-of-00002.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:65e6541afdabbb96568a3f8975eeef929f0a7e0eef3d2c4741b1bf911ac3a6d5
3
+ size 7853894360
transformer/diffusion_pytorch_model.safetensors.index.json ADDED
The diff for this file is too large to render. See raw diff
 
vae/config.json ADDED
@@ -0,0 +1,38 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_class_name": "AutoencoderKL",
3
+ "_diffusers_version": "0.35.1",
4
+ "_name_or_path": "/home/ubuntu/FLUX.1-schnell",
5
+ "act_fn": "silu",
6
+ "block_out_channels": [
7
+ 128,
8
+ 256,
9
+ 512,
10
+ 512
11
+ ],
12
+ "down_block_types": [
13
+ "DownEncoderBlock2D",
14
+ "DownEncoderBlock2D",
15
+ "DownEncoderBlock2D",
16
+ "DownEncoderBlock2D"
17
+ ],
18
+ "force_upcast": true,
19
+ "in_channels": 3,
20
+ "latent_channels": 16,
21
+ "latents_mean": null,
22
+ "latents_std": null,
23
+ "layers_per_block": 2,
24
+ "mid_block_add_attention": true,
25
+ "norm_num_groups": 32,
26
+ "out_channels": 3,
27
+ "sample_size": 1024,
28
+ "scaling_factor": 0.3611,
29
+ "shift_factor": 0.1159,
30
+ "up_block_types": [
31
+ "UpDecoderBlock2D",
32
+ "UpDecoderBlock2D",
33
+ "UpDecoderBlock2D",
34
+ "UpDecoderBlock2D"
35
+ ],
36
+ "use_post_quant_conv": false,
37
+ "use_quant_conv": false
38
+ }
vae/diffusion_pytorch_model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f5b59a26851551b67ae1fe58d32e76486e1e812def4696a4bea97f16604d40a3
3
+ size 167666902