EEEric commited on
Commit
6a5c078
·
verified ·
1 Parent(s): fb65a86

End of training

Browse files
Files changed (39) hide show
  1. 3d-icon-Flux-LoRA_emb.safetensors +3 -0
  2. README.md +85 -0
  3. logs/dreambooth-flux-dev-lora-advanced/1735568051.6899648/events.out.tfevents.1735568051.gpuserver-14.827835.1 +3 -0
  4. logs/dreambooth-flux-dev-lora-advanced/1735568051.6936898/hparams.yml +80 -0
  5. logs/dreambooth-flux-dev-lora-advanced/1735568916.4220107/events.out.tfevents.1735568916.gpuserver-14.831807.1 +3 -0
  6. logs/dreambooth-flux-dev-lora-advanced/1735568916.4257083/hparams.yml +80 -0
  7. logs/dreambooth-flux-dev-lora-advanced/1735569547.8011496/events.out.tfevents.1735569547.gpuserver-14.835448.1 +3 -0
  8. logs/dreambooth-flux-dev-lora-advanced/1735569547.8049138/hparams.yml +80 -0
  9. logs/dreambooth-flux-dev-lora-advanced/1735569786.2874458/events.out.tfevents.1735569786.gpuserver-14.837421.1 +3 -0
  10. logs/dreambooth-flux-dev-lora-advanced/1735569786.2912216/hparams.yml +80 -0
  11. logs/dreambooth-flux-dev-lora-advanced/1735570108.5543733/events.out.tfevents.1735570108.gpuserver-14.840330.1 +3 -0
  12. logs/dreambooth-flux-dev-lora-advanced/1735570108.5581105/hparams.yml +80 -0
  13. logs/dreambooth-flux-dev-lora-advanced/1735570348.7992985/events.out.tfevents.1735570348.gpuserver-14.841662.1 +3 -0
  14. logs/dreambooth-flux-dev-lora-advanced/1735570348.8030798/hparams.yml +80 -0
  15. logs/dreambooth-flux-dev-lora-advanced/1735570748.869957/events.out.tfevents.1735570748.gpuserver-14.843533.1 +3 -0
  16. logs/dreambooth-flux-dev-lora-advanced/1735570748.8737948/hparams.yml +80 -0
  17. logs/dreambooth-flux-dev-lora-advanced/1735574460.775173/events.out.tfevents.1735574460.gpuserver-14.856866.1 +3 -0
  18. logs/dreambooth-flux-dev-lora-advanced/1735574460.7789776/hparams.yml +80 -0
  19. logs/dreambooth-flux-dev-lora-advanced/1735574668.2935011/events.out.tfevents.1735574668.gpuserver-14.858252.1 +3 -0
  20. logs/dreambooth-flux-dev-lora-advanced/1735574668.31025/hparams.yml +80 -0
  21. logs/dreambooth-flux-dev-lora-advanced/1735574990.5713248/events.out.tfevents.1735574990.gpuserver-14.860016.1 +3 -0
  22. logs/dreambooth-flux-dev-lora-advanced/1735574990.57511/hparams.yml +80 -0
  23. logs/dreambooth-flux-dev-lora-advanced/1735610269.231504/events.out.tfevents.1735610269.gpuserver-14.871398.1 +3 -0
  24. logs/dreambooth-flux-dev-lora-advanced/1735610269.2359283/hparams.yml +80 -0
  25. logs/dreambooth-flux-dev-lora-advanced/1735610525.572426/events.out.tfevents.1735610525.gpuserver-14.873358.1 +3 -0
  26. logs/dreambooth-flux-dev-lora-advanced/1735610525.5761664/hparams.yml +80 -0
  27. logs/dreambooth-flux-dev-lora-advanced/events.out.tfevents.1735568051.gpuserver-14.827835.0 +3 -0
  28. logs/dreambooth-flux-dev-lora-advanced/events.out.tfevents.1735568916.gpuserver-14.831807.0 +3 -0
  29. logs/dreambooth-flux-dev-lora-advanced/events.out.tfevents.1735569547.gpuserver-14.835448.0 +3 -0
  30. logs/dreambooth-flux-dev-lora-advanced/events.out.tfevents.1735569786.gpuserver-14.837421.0 +3 -0
  31. logs/dreambooth-flux-dev-lora-advanced/events.out.tfevents.1735570108.gpuserver-14.840330.0 +3 -0
  32. logs/dreambooth-flux-dev-lora-advanced/events.out.tfevents.1735570348.gpuserver-14.841662.0 +3 -0
  33. logs/dreambooth-flux-dev-lora-advanced/events.out.tfevents.1735570748.gpuserver-14.843533.0 +3 -0
  34. logs/dreambooth-flux-dev-lora-advanced/events.out.tfevents.1735574460.gpuserver-14.856866.0 +3 -0
  35. logs/dreambooth-flux-dev-lora-advanced/events.out.tfevents.1735574668.gpuserver-14.858252.0 +3 -0
  36. logs/dreambooth-flux-dev-lora-advanced/events.out.tfevents.1735574990.gpuserver-14.860016.0 +3 -0
  37. logs/dreambooth-flux-dev-lora-advanced/events.out.tfevents.1735610269.gpuserver-14.871398.0 +3 -0
  38. logs/dreambooth-flux-dev-lora-advanced/events.out.tfevents.1735610525.gpuserver-14.873358.0 +3 -0
  39. pytorch_lora_weights.safetensors +3 -0
3d-icon-Flux-LoRA_emb.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ca2b383d3c800a28be7d904fa674301e835877da7d9fec2c39112cd66862f964
3
+ size 6224
README.md ADDED
@@ -0,0 +1,85 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: black-forest-labs/FLUX.1-dev
3
+ library_name: diffusers
4
+ license: other
5
+ instance_prompt: 3d icon in the style of <s0><s1>
6
+ widget: []
7
+ tags:
8
+ - text-to-image
9
+ - diffusers-training
10
+ - diffusers
11
+ - lora
12
+ - flux
13
+ - flux-diffusers
14
+ - template:sd-lora
15
+ ---
16
+
17
+ <!-- This model card has been generated automatically according to the information the training script had access to. You
18
+ should probably proofread and complete it, then remove this comment. -->
19
+
20
+
21
+ # Flux DreamBooth LoRA - EEEric/3d-icon-Flux-LoRA
22
+
23
+ <Gallery />
24
+
25
+ ## Model description
26
+
27
+ These are EEEric/3d-icon-Flux-LoRA DreamBooth LoRA weights for black-forest-labs/FLUX.1-dev.
28
+
29
+ The weights were trained using [DreamBooth](https://dreambooth.github.io/) with the [Flux diffusers trainer](https://github.com/huggingface/diffusers/blob/main/examples/dreambooth/README_flux.md).
30
+
31
+ Was LoRA for the text encoder enabled? False.
32
+
33
+ Pivotal tuning was enabled: True.
34
+
35
+ ## Trigger words
36
+
37
+ To trigger image generation of trained concept(or concepts) replace each concept identifier in you prompt with the new inserted tokens:
38
+
39
+ to trigger concept `TOK` → use `<s0><s1>` in your prompt
40
+
41
+
42
+
43
+ ## Download model
44
+
45
+ [Download the *.safetensors LoRA](EEEric/3d-icon-Flux-LoRA/tree/main) in the Files & versions tab.
46
+
47
+ ## Use it with the [🧨 diffusers library](https://github.com/huggingface/diffusers)
48
+
49
+ ```py
50
+ from diffusers import AutoPipelineForText2Image
51
+ import torch
52
+ from huggingface_hub import hf_hub_download
53
+ from safetensors.torch import load_file
54
+
55
+ pipeline = AutoPipelineForText2Image.from_pretrained("black-forest-labs/FLUX.1-dev", torch_dtype=torch.bfloat16).to('cuda')
56
+ pipeline.load_lora_weights('EEEric/3d-icon-Flux-LoRA', weight_name='pytorch_lora_weights.safetensors')
57
+ embedding_path = hf_hub_download(repo_id='EEEric/3d-icon-Flux-LoRA', filename='3d-icon-Flux-LoRA_emb.safetensors', repo_type="model")
58
+ state_dict = load_file(embedding_path)
59
+ pipeline.load_textual_inversion(state_dict["clip_l"], token=["<s0>", "<s1>"], text_encoder=pipeline.text_encoder, tokenizer=pipeline.tokenizer)
60
+
61
+ image = pipeline('3d icon in the style of <s0><s1>').images[0]
62
+ ```
63
+
64
+ For more details, including weighting, merging and fusing LoRAs, check the [documentation on loading LoRAs in diffusers](https://huggingface.co/docs/diffusers/main/en/using-diffusers/loading_adapters)
65
+
66
+ ## License
67
+
68
+ Please adhere to the licensing terms as described [here](https://huggingface.co/black-forest-labs/FLUX.1-dev/blob/main/LICENSE.md).
69
+
70
+
71
+ ## Intended uses & limitations
72
+
73
+ #### How to use
74
+
75
+ ```python
76
+ # TODO: add an example code snippet for running this diffusion pipeline
77
+ ```
78
+
79
+ #### Limitations and bias
80
+
81
+ [TODO: provide examples of latent issues and potential remediations]
82
+
83
+ ## Training details
84
+
85
+ [TODO: describe the data used to train the model]
logs/dreambooth-flux-dev-lora-advanced/1735568051.6899648/events.out.tfevents.1735568051.gpuserver-14.827835.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0fd3eec56d9544db8c165f27813f3b695787a9b76d4258896443ab8380db2b88
3
+ size 3586
logs/dreambooth-flux-dev-lora-advanced/1735568051.6936898/hparams.yml ADDED
@@ -0,0 +1,80 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ adam_beta1: 0.9
2
+ adam_beta2: 0.999
3
+ adam_epsilon: 1.0e-08
4
+ adam_weight_decay: 0.0001
5
+ adam_weight_decay_text_encoder: 0.001
6
+ allow_tf32: false
7
+ cache_dir: null
8
+ cache_latents: false
9
+ caption_column: prompt
10
+ center_crop: false
11
+ checkpointing_steps: 2000
12
+ checkpoints_total_limit: null
13
+ class_data_dir: null
14
+ class_prompt: null
15
+ dataloader_num_workers: 0
16
+ dataset_config_name: null
17
+ dataset_name: ./3d_icon
18
+ enable_t5_ti: false
19
+ gradient_accumulation_steps: 1
20
+ gradient_checkpointing: true
21
+ guidance_scale: 3.5
22
+ hub_model_id: null
23
+ hub_token: null
24
+ image_column: image
25
+ initializer_concept: null
26
+ instance_data_dir: null
27
+ instance_prompt: 3d icon in the style of <s0><s1>
28
+ learning_rate: 1.0
29
+ local_rank: 0
30
+ logging_dir: logs
31
+ logit_mean: 0.0
32
+ logit_std: 1.0
33
+ lora_layers: null
34
+ lr_num_cycles: 1
35
+ lr_power: 1.0
36
+ lr_scheduler: constant
37
+ lr_warmup_steps: 0
38
+ max_grad_norm: 1.0
39
+ max_sequence_length: 512
40
+ max_train_steps: 700
41
+ mixed_precision: bf16
42
+ mode_scale: 1.29
43
+ num_class_images: 100
44
+ num_new_tokens_per_abstraction: null
45
+ num_train_epochs: 234
46
+ num_validation_images: 4
47
+ optimizer: prodigy
48
+ output_dir: 3d-icon-Flux-LoRA
49
+ pretrained_model_name_or_path: black-forest-labs/FLUX.1-dev
50
+ prior_generation_precision: null
51
+ prior_loss_weight: 1.0
52
+ prodigy_beta3: null
53
+ prodigy_decouple: true
54
+ prodigy_safeguard_warmup: true
55
+ prodigy_use_bias_correction: true
56
+ push_to_hub: false
57
+ random_flip: false
58
+ rank: 8
59
+ repeats: 1
60
+ report_to: tensorboard
61
+ resolution: 1024
62
+ resume_from_checkpoint: null
63
+ revision: null
64
+ sample_batch_size: 4
65
+ scale_lr: false
66
+ seed: 0
67
+ text_encoder_lr: 1.0
68
+ token_abstraction: TOK
69
+ train_batch_size: 1
70
+ train_text_encoder: false
71
+ train_text_encoder_frac: 1.0
72
+ train_text_encoder_ti: true
73
+ train_text_encoder_ti_frac: 0.5
74
+ train_transformer_frac: 1.0
75
+ use_8bit_adam: false
76
+ validation_epochs: 50
77
+ validation_prompt: null
78
+ variant: null
79
+ weighting_scheme: none
80
+ with_prior_preservation: false
logs/dreambooth-flux-dev-lora-advanced/1735568916.4220107/events.out.tfevents.1735568916.gpuserver-14.831807.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:282f73e269b3aee3d317659343590ae064422208b2e67bc29637f891e540d562
3
+ size 3586
logs/dreambooth-flux-dev-lora-advanced/1735568916.4257083/hparams.yml ADDED
@@ -0,0 +1,80 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ adam_beta1: 0.9
2
+ adam_beta2: 0.999
3
+ adam_epsilon: 1.0e-08
4
+ adam_weight_decay: 0.0001
5
+ adam_weight_decay_text_encoder: 0.001
6
+ allow_tf32: false
7
+ cache_dir: null
8
+ cache_latents: false
9
+ caption_column: prompt
10
+ center_crop: false
11
+ checkpointing_steps: 2000
12
+ checkpoints_total_limit: null
13
+ class_data_dir: null
14
+ class_prompt: null
15
+ dataloader_num_workers: 0
16
+ dataset_config_name: null
17
+ dataset_name: ./3d_icon
18
+ enable_t5_ti: false
19
+ gradient_accumulation_steps: 1
20
+ gradient_checkpointing: true
21
+ guidance_scale: 3.5
22
+ hub_model_id: null
23
+ hub_token: null
24
+ image_column: image
25
+ initializer_concept: null
26
+ instance_data_dir: null
27
+ instance_prompt: 3d icon in the style of <s0><s1>
28
+ learning_rate: 1.0
29
+ local_rank: 0
30
+ logging_dir: logs
31
+ logit_mean: 0.0
32
+ logit_std: 1.0
33
+ lora_layers: null
34
+ lr_num_cycles: 1
35
+ lr_power: 1.0
36
+ lr_scheduler: constant
37
+ lr_warmup_steps: 0
38
+ max_grad_norm: 1.0
39
+ max_sequence_length: 512
40
+ max_train_steps: 700
41
+ mixed_precision: bf16
42
+ mode_scale: 1.29
43
+ num_class_images: 100
44
+ num_new_tokens_per_abstraction: null
45
+ num_train_epochs: 234
46
+ num_validation_images: 4
47
+ optimizer: prodigy
48
+ output_dir: 3d-icon-Flux-LoRA
49
+ pretrained_model_name_or_path: black-forest-labs/FLUX.1-dev
50
+ prior_generation_precision: null
51
+ prior_loss_weight: 1.0
52
+ prodigy_beta3: null
53
+ prodigy_decouple: true
54
+ prodigy_safeguard_warmup: true
55
+ prodigy_use_bias_correction: true
56
+ push_to_hub: false
57
+ random_flip: false
58
+ rank: 8
59
+ repeats: 1
60
+ report_to: tensorboard
61
+ resolution: 1024
62
+ resume_from_checkpoint: null
63
+ revision: null
64
+ sample_batch_size: 4
65
+ scale_lr: false
66
+ seed: 0
67
+ text_encoder_lr: 1.0
68
+ token_abstraction: TOK
69
+ train_batch_size: 1
70
+ train_text_encoder: false
71
+ train_text_encoder_frac: 1.0
72
+ train_text_encoder_ti: true
73
+ train_text_encoder_ti_frac: 0.5
74
+ train_transformer_frac: 1.0
75
+ use_8bit_adam: false
76
+ validation_epochs: 50
77
+ validation_prompt: null
78
+ variant: null
79
+ weighting_scheme: none
80
+ with_prior_preservation: false
logs/dreambooth-flux-dev-lora-advanced/1735569547.8011496/events.out.tfevents.1735569547.gpuserver-14.835448.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d4fb80907791cedb52fc50dbcb2419d5438494b1b0fad6903e1e04d6646f7dcc
3
+ size 3586
logs/dreambooth-flux-dev-lora-advanced/1735569547.8049138/hparams.yml ADDED
@@ -0,0 +1,80 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ adam_beta1: 0.9
2
+ adam_beta2: 0.999
3
+ adam_epsilon: 1.0e-08
4
+ adam_weight_decay: 0.0001
5
+ adam_weight_decay_text_encoder: 0.001
6
+ allow_tf32: false
7
+ cache_dir: null
8
+ cache_latents: false
9
+ caption_column: prompt
10
+ center_crop: false
11
+ checkpointing_steps: 2000
12
+ checkpoints_total_limit: null
13
+ class_data_dir: null
14
+ class_prompt: null
15
+ dataloader_num_workers: 0
16
+ dataset_config_name: null
17
+ dataset_name: ./3d_icon
18
+ enable_t5_ti: false
19
+ gradient_accumulation_steps: 1
20
+ gradient_checkpointing: false
21
+ guidance_scale: 3.5
22
+ hub_model_id: null
23
+ hub_token: null
24
+ image_column: image
25
+ initializer_concept: null
26
+ instance_data_dir: null
27
+ instance_prompt: 3d icon in the style of <s0><s1>
28
+ learning_rate: 1.0
29
+ local_rank: 0
30
+ logging_dir: logs
31
+ logit_mean: 0.0
32
+ logit_std: 1.0
33
+ lora_layers: null
34
+ lr_num_cycles: 1
35
+ lr_power: 1.0
36
+ lr_scheduler: constant
37
+ lr_warmup_steps: 0
38
+ max_grad_norm: 1.0
39
+ max_sequence_length: 512
40
+ max_train_steps: 700
41
+ mixed_precision: bf16
42
+ mode_scale: 1.29
43
+ num_class_images: 100
44
+ num_new_tokens_per_abstraction: null
45
+ num_train_epochs: 234
46
+ num_validation_images: 4
47
+ optimizer: prodigy
48
+ output_dir: 3d-icon-Flux-LoRA
49
+ pretrained_model_name_or_path: black-forest-labs/FLUX.1-dev
50
+ prior_generation_precision: null
51
+ prior_loss_weight: 1.0
52
+ prodigy_beta3: null
53
+ prodigy_decouple: true
54
+ prodigy_safeguard_warmup: true
55
+ prodigy_use_bias_correction: true
56
+ push_to_hub: false
57
+ random_flip: false
58
+ rank: 8
59
+ repeats: 1
60
+ report_to: tensorboard
61
+ resolution: 1024
62
+ resume_from_checkpoint: null
63
+ revision: null
64
+ sample_batch_size: 4
65
+ scale_lr: false
66
+ seed: 0
67
+ text_encoder_lr: 1.0
68
+ token_abstraction: TOK
69
+ train_batch_size: 1
70
+ train_text_encoder: false
71
+ train_text_encoder_frac: 1.0
72
+ train_text_encoder_ti: true
73
+ train_text_encoder_ti_frac: 0.5
74
+ train_transformer_frac: 1.0
75
+ use_8bit_adam: false
76
+ validation_epochs: 50
77
+ validation_prompt: null
78
+ variant: null
79
+ weighting_scheme: none
80
+ with_prior_preservation: false
logs/dreambooth-flux-dev-lora-advanced/1735569786.2874458/events.out.tfevents.1735569786.gpuserver-14.837421.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:193184d1aded9817bdc0a911ad91b735ff37f0ff195ddc41023b520013b14e75
3
+ size 3586
logs/dreambooth-flux-dev-lora-advanced/1735569786.2912216/hparams.yml ADDED
@@ -0,0 +1,80 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ adam_beta1: 0.9
2
+ adam_beta2: 0.999
3
+ adam_epsilon: 1.0e-08
4
+ adam_weight_decay: 0.0001
5
+ adam_weight_decay_text_encoder: 0.001
6
+ allow_tf32: false
7
+ cache_dir: null
8
+ cache_latents: false
9
+ caption_column: prompt
10
+ center_crop: false
11
+ checkpointing_steps: 2000
12
+ checkpoints_total_limit: null
13
+ class_data_dir: null
14
+ class_prompt: null
15
+ dataloader_num_workers: 0
16
+ dataset_config_name: null
17
+ dataset_name: ./3d_icon
18
+ enable_t5_ti: false
19
+ gradient_accumulation_steps: 1
20
+ gradient_checkpointing: false
21
+ guidance_scale: 3.5
22
+ hub_model_id: null
23
+ hub_token: null
24
+ image_column: image
25
+ initializer_concept: null
26
+ instance_data_dir: null
27
+ instance_prompt: 3d icon in the style of <s0><s1>
28
+ learning_rate: 1.0
29
+ local_rank: 0
30
+ logging_dir: logs
31
+ logit_mean: 0.0
32
+ logit_std: 1.0
33
+ lora_layers: null
34
+ lr_num_cycles: 1
35
+ lr_power: 1.0
36
+ lr_scheduler: constant
37
+ lr_warmup_steps: 0
38
+ max_grad_norm: 1.0
39
+ max_sequence_length: 512
40
+ max_train_steps: 700
41
+ mixed_precision: bf16
42
+ mode_scale: 1.29
43
+ num_class_images: 100
44
+ num_new_tokens_per_abstraction: null
45
+ num_train_epochs: 234
46
+ num_validation_images: 4
47
+ optimizer: prodigy
48
+ output_dir: 3d-icon-Flux-LoRA
49
+ pretrained_model_name_or_path: black-forest-labs/FLUX.1-dev
50
+ prior_generation_precision: null
51
+ prior_loss_weight: 1.0
52
+ prodigy_beta3: null
53
+ prodigy_decouple: true
54
+ prodigy_safeguard_warmup: true
55
+ prodigy_use_bias_correction: true
56
+ push_to_hub: false
57
+ random_flip: false
58
+ rank: 8
59
+ repeats: 1
60
+ report_to: tensorboard
61
+ resolution: 1024
62
+ resume_from_checkpoint: null
63
+ revision: null
64
+ sample_batch_size: 4
65
+ scale_lr: false
66
+ seed: 0
67
+ text_encoder_lr: 1.0
68
+ token_abstraction: TOK
69
+ train_batch_size: 1
70
+ train_text_encoder: false
71
+ train_text_encoder_frac: 1.0
72
+ train_text_encoder_ti: true
73
+ train_text_encoder_ti_frac: 0.5
74
+ train_transformer_frac: 1.0
75
+ use_8bit_adam: false
76
+ validation_epochs: 50
77
+ validation_prompt: null
78
+ variant: null
79
+ weighting_scheme: none
80
+ with_prior_preservation: false
logs/dreambooth-flux-dev-lora-advanced/1735570108.5543733/events.out.tfevents.1735570108.gpuserver-14.840330.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:18607c66a0fb87d3ba2a3bd4adbea288c0b412f7bcefa7b094189d08f58ec3fc
3
+ size 3586
logs/dreambooth-flux-dev-lora-advanced/1735570108.5581105/hparams.yml ADDED
@@ -0,0 +1,80 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ adam_beta1: 0.9
2
+ adam_beta2: 0.999
3
+ adam_epsilon: 1.0e-08
4
+ adam_weight_decay: 0.0001
5
+ adam_weight_decay_text_encoder: 0.001
6
+ allow_tf32: false
7
+ cache_dir: null
8
+ cache_latents: false
9
+ caption_column: prompt
10
+ center_crop: false
11
+ checkpointing_steps: 2000
12
+ checkpoints_total_limit: null
13
+ class_data_dir: null
14
+ class_prompt: null
15
+ dataloader_num_workers: 0
16
+ dataset_config_name: null
17
+ dataset_name: ./3d_icon
18
+ enable_t5_ti: false
19
+ gradient_accumulation_steps: 1
20
+ gradient_checkpointing: false
21
+ guidance_scale: 3.5
22
+ hub_model_id: null
23
+ hub_token: null
24
+ image_column: image
25
+ initializer_concept: null
26
+ instance_data_dir: null
27
+ instance_prompt: 3d icon in the style of <s0><s1>
28
+ learning_rate: 1.0
29
+ local_rank: 0
30
+ logging_dir: logs
31
+ logit_mean: 0.0
32
+ logit_std: 1.0
33
+ lora_layers: null
34
+ lr_num_cycles: 1
35
+ lr_power: 1.0
36
+ lr_scheduler: constant
37
+ lr_warmup_steps: 0
38
+ max_grad_norm: 1.0
39
+ max_sequence_length: 512
40
+ max_train_steps: 700
41
+ mixed_precision: bf16
42
+ mode_scale: 1.29
43
+ num_class_images: 100
44
+ num_new_tokens_per_abstraction: null
45
+ num_train_epochs: 234
46
+ num_validation_images: 4
47
+ optimizer: prodigy
48
+ output_dir: 3d-icon-Flux-LoRA
49
+ pretrained_model_name_or_path: black-forest-labs/FLUX.1-dev
50
+ prior_generation_precision: null
51
+ prior_loss_weight: 1.0
52
+ prodigy_beta3: null
53
+ prodigy_decouple: true
54
+ prodigy_safeguard_warmup: true
55
+ prodigy_use_bias_correction: true
56
+ push_to_hub: false
57
+ random_flip: false
58
+ rank: 8
59
+ repeats: 1
60
+ report_to: tensorboard
61
+ resolution: 1024
62
+ resume_from_checkpoint: null
63
+ revision: null
64
+ sample_batch_size: 4
65
+ scale_lr: false
66
+ seed: 0
67
+ text_encoder_lr: 1.0
68
+ token_abstraction: TOK
69
+ train_batch_size: 1
70
+ train_text_encoder: false
71
+ train_text_encoder_frac: 1.0
72
+ train_text_encoder_ti: true
73
+ train_text_encoder_ti_frac: 0.5
74
+ train_transformer_frac: 1.0
75
+ use_8bit_adam: false
76
+ validation_epochs: 50
77
+ validation_prompt: null
78
+ variant: null
79
+ weighting_scheme: none
80
+ with_prior_preservation: false
logs/dreambooth-flux-dev-lora-advanced/1735570348.7992985/events.out.tfevents.1735570348.gpuserver-14.841662.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dbe0e1d4b500179a5f5702f502f3dfcccad6cebe1fb49210b1aa90a12b1ce4f3
3
+ size 3586
logs/dreambooth-flux-dev-lora-advanced/1735570348.8030798/hparams.yml ADDED
@@ -0,0 +1,80 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ adam_beta1: 0.9
2
+ adam_beta2: 0.999
3
+ adam_epsilon: 1.0e-08
4
+ adam_weight_decay: 0.0001
5
+ adam_weight_decay_text_encoder: 0.001
6
+ allow_tf32: false
7
+ cache_dir: null
8
+ cache_latents: false
9
+ caption_column: prompt
10
+ center_crop: false
11
+ checkpointing_steps: 2000
12
+ checkpoints_total_limit: null
13
+ class_data_dir: null
14
+ class_prompt: null
15
+ dataloader_num_workers: 0
16
+ dataset_config_name: null
17
+ dataset_name: ./3d_icon
18
+ enable_t5_ti: false
19
+ gradient_accumulation_steps: 1
20
+ gradient_checkpointing: false
21
+ guidance_scale: 3.5
22
+ hub_model_id: null
23
+ hub_token: null
24
+ image_column: image
25
+ initializer_concept: null
26
+ instance_data_dir: null
27
+ instance_prompt: 3d icon in the style of <s0><s1>
28
+ learning_rate: 1.0
29
+ local_rank: 0
30
+ logging_dir: logs
31
+ logit_mean: 0.0
32
+ logit_std: 1.0
33
+ lora_layers: null
34
+ lr_num_cycles: 1
35
+ lr_power: 1.0
36
+ lr_scheduler: constant
37
+ lr_warmup_steps: 0
38
+ max_grad_norm: 1.0
39
+ max_sequence_length: 512
40
+ max_train_steps: 700
41
+ mixed_precision: bf16
42
+ mode_scale: 1.29
43
+ num_class_images: 100
44
+ num_new_tokens_per_abstraction: null
45
+ num_train_epochs: 234
46
+ num_validation_images: 4
47
+ optimizer: prodigy
48
+ output_dir: 3d-icon-Flux-LoRA
49
+ pretrained_model_name_or_path: black-forest-labs/FLUX.1-dev
50
+ prior_generation_precision: null
51
+ prior_loss_weight: 1.0
52
+ prodigy_beta3: null
53
+ prodigy_decouple: true
54
+ prodigy_safeguard_warmup: true
55
+ prodigy_use_bias_correction: true
56
+ push_to_hub: false
57
+ random_flip: false
58
+ rank: 8
59
+ repeats: 1
60
+ report_to: tensorboard
61
+ resolution: 1024
62
+ resume_from_checkpoint: null
63
+ revision: null
64
+ sample_batch_size: 4
65
+ scale_lr: false
66
+ seed: 0
67
+ text_encoder_lr: 1.0
68
+ token_abstraction: TOK
69
+ train_batch_size: 1
70
+ train_text_encoder: false
71
+ train_text_encoder_frac: 1.0
72
+ train_text_encoder_ti: true
73
+ train_text_encoder_ti_frac: 0.5
74
+ train_transformer_frac: 1.0
75
+ use_8bit_adam: false
76
+ validation_epochs: 50
77
+ validation_prompt: null
78
+ variant: null
79
+ weighting_scheme: none
80
+ with_prior_preservation: false
logs/dreambooth-flux-dev-lora-advanced/1735570748.869957/events.out.tfevents.1735570748.gpuserver-14.843533.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4017304b2a1e3e8606121c0e266523ae3fa9fe073aca4802311f330b6252a32e
3
+ size 3586
logs/dreambooth-flux-dev-lora-advanced/1735570748.8737948/hparams.yml ADDED
@@ -0,0 +1,80 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ adam_beta1: 0.9
2
+ adam_beta2: 0.999
3
+ adam_epsilon: 1.0e-08
4
+ adam_weight_decay: 0.0001
5
+ adam_weight_decay_text_encoder: 0.001
6
+ allow_tf32: false
7
+ cache_dir: null
8
+ cache_latents: false
9
+ caption_column: prompt
10
+ center_crop: false
11
+ checkpointing_steps: 2000
12
+ checkpoints_total_limit: null
13
+ class_data_dir: null
14
+ class_prompt: null
15
+ dataloader_num_workers: 0
16
+ dataset_config_name: null
17
+ dataset_name: ./3d_icon
18
+ enable_t5_ti: false
19
+ gradient_accumulation_steps: 1
20
+ gradient_checkpointing: false
21
+ guidance_scale: 3.5
22
+ hub_model_id: null
23
+ hub_token: null
24
+ image_column: image
25
+ initializer_concept: null
26
+ instance_data_dir: null
27
+ instance_prompt: 3d icon in the style of <s0><s1>
28
+ learning_rate: 1.0
29
+ local_rank: 0
30
+ logging_dir: logs
31
+ logit_mean: 0.0
32
+ logit_std: 1.0
33
+ lora_layers: null
34
+ lr_num_cycles: 1
35
+ lr_power: 1.0
36
+ lr_scheduler: constant
37
+ lr_warmup_steps: 0
38
+ max_grad_norm: 1.0
39
+ max_sequence_length: 512
40
+ max_train_steps: 700
41
+ mixed_precision: bf16
42
+ mode_scale: 1.29
43
+ num_class_images: 100
44
+ num_new_tokens_per_abstraction: null
45
+ num_train_epochs: 234
46
+ num_validation_images: 4
47
+ optimizer: prodigy
48
+ output_dir: 3d-icon-Flux-LoRA
49
+ pretrained_model_name_or_path: black-forest-labs/FLUX.1-dev
50
+ prior_generation_precision: null
51
+ prior_loss_weight: 1.0
52
+ prodigy_beta3: null
53
+ prodigy_decouple: true
54
+ prodigy_safeguard_warmup: true
55
+ prodigy_use_bias_correction: true
56
+ push_to_hub: false
57
+ random_flip: false
58
+ rank: 8
59
+ repeats: 1
60
+ report_to: tensorboard
61
+ resolution: 1024
62
+ resume_from_checkpoint: null
63
+ revision: null
64
+ sample_batch_size: 4
65
+ scale_lr: false
66
+ seed: 0
67
+ text_encoder_lr: 1.0
68
+ token_abstraction: TOK
69
+ train_batch_size: 1
70
+ train_text_encoder: false
71
+ train_text_encoder_frac: 1.0
72
+ train_text_encoder_ti: true
73
+ train_text_encoder_ti_frac: 0.5
74
+ train_transformer_frac: 1.0
75
+ use_8bit_adam: false
76
+ validation_epochs: 50
77
+ validation_prompt: null
78
+ variant: null
79
+ weighting_scheme: none
80
+ with_prior_preservation: false
logs/dreambooth-flux-dev-lora-advanced/1735574460.775173/events.out.tfevents.1735574460.gpuserver-14.856866.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:02eaedc52aa3a4e4f420d938278aebe0636ca4c52cec2b57ba74eebbbeb0e10d
3
+ size 3586
logs/dreambooth-flux-dev-lora-advanced/1735574460.7789776/hparams.yml ADDED
@@ -0,0 +1,80 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ adam_beta1: 0.9
2
+ adam_beta2: 0.999
3
+ adam_epsilon: 1.0e-08
4
+ adam_weight_decay: 0.0001
5
+ adam_weight_decay_text_encoder: 0.001
6
+ allow_tf32: false
7
+ cache_dir: null
8
+ cache_latents: false
9
+ caption_column: prompt
10
+ center_crop: false
11
+ checkpointing_steps: 2000
12
+ checkpoints_total_limit: null
13
+ class_data_dir: null
14
+ class_prompt: null
15
+ dataloader_num_workers: 0
16
+ dataset_config_name: null
17
+ dataset_name: ./3d_icon
18
+ enable_t5_ti: false
19
+ gradient_accumulation_steps: 1
20
+ gradient_checkpointing: false
21
+ guidance_scale: 3.5
22
+ hub_model_id: null
23
+ hub_token: null
24
+ image_column: image
25
+ initializer_concept: null
26
+ instance_data_dir: null
27
+ instance_prompt: 3d icon in the style of <s0><s1>
28
+ learning_rate: 1.0
29
+ local_rank: 0
30
+ logging_dir: logs
31
+ logit_mean: 0.0
32
+ logit_std: 1.0
33
+ lora_layers: null
34
+ lr_num_cycles: 1
35
+ lr_power: 1.0
36
+ lr_scheduler: constant
37
+ lr_warmup_steps: 0
38
+ max_grad_norm: 1.0
39
+ max_sequence_length: 512
40
+ max_train_steps: 700
41
+ mixed_precision: bf16
42
+ mode_scale: 1.29
43
+ num_class_images: 100
44
+ num_new_tokens_per_abstraction: null
45
+ num_train_epochs: 234
46
+ num_validation_images: 4
47
+ optimizer: prodigy
48
+ output_dir: 3d-icon-Flux-LoRA
49
+ pretrained_model_name_or_path: black-forest-labs/FLUX.1-dev
50
+ prior_generation_precision: null
51
+ prior_loss_weight: 1.0
52
+ prodigy_beta3: null
53
+ prodigy_decouple: true
54
+ prodigy_safeguard_warmup: true
55
+ prodigy_use_bias_correction: true
56
+ push_to_hub: false
57
+ random_flip: false
58
+ rank: 8
59
+ repeats: 1
60
+ report_to: tensorboard
61
+ resolution: 1024
62
+ resume_from_checkpoint: null
63
+ revision: null
64
+ sample_batch_size: 4
65
+ scale_lr: false
66
+ seed: 0
67
+ text_encoder_lr: 1.0
68
+ token_abstraction: TOK
69
+ train_batch_size: 1
70
+ train_text_encoder: false
71
+ train_text_encoder_frac: 1.0
72
+ train_text_encoder_ti: true
73
+ train_text_encoder_ti_frac: 0.5
74
+ train_transformer_frac: 1.0
75
+ use_8bit_adam: false
76
+ validation_epochs: 50
77
+ validation_prompt: null
78
+ variant: null
79
+ weighting_scheme: none
80
+ with_prior_preservation: false
logs/dreambooth-flux-dev-lora-advanced/1735574668.2935011/events.out.tfevents.1735574668.gpuserver-14.858252.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c1dad44e3a3bd168ab287339ce444c699f39f26f67d036998efe97e656d81f11
3
+ size 3586
logs/dreambooth-flux-dev-lora-advanced/1735574668.31025/hparams.yml ADDED
@@ -0,0 +1,80 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ adam_beta1: 0.9
2
+ adam_beta2: 0.999
3
+ adam_epsilon: 1.0e-08
4
+ adam_weight_decay: 0.0001
5
+ adam_weight_decay_text_encoder: 0.001
6
+ allow_tf32: false
7
+ cache_dir: null
8
+ cache_latents: false
9
+ caption_column: prompt
10
+ center_crop: false
11
+ checkpointing_steps: 2000
12
+ checkpoints_total_limit: null
13
+ class_data_dir: null
14
+ class_prompt: null
15
+ dataloader_num_workers: 0
16
+ dataset_config_name: null
17
+ dataset_name: ./3d_icon
18
+ enable_t5_ti: false
19
+ gradient_accumulation_steps: 1
20
+ gradient_checkpointing: false
21
+ guidance_scale: 3.5
22
+ hub_model_id: null
23
+ hub_token: null
24
+ image_column: image
25
+ initializer_concept: null
26
+ instance_data_dir: null
27
+ instance_prompt: 3d icon in the style of <s0><s1>
28
+ learning_rate: 1.0
29
+ local_rank: 0
30
+ logging_dir: logs
31
+ logit_mean: 0.0
32
+ logit_std: 1.0
33
+ lora_layers: null
34
+ lr_num_cycles: 1
35
+ lr_power: 1.0
36
+ lr_scheduler: constant
37
+ lr_warmup_steps: 0
38
+ max_grad_norm: 1.0
39
+ max_sequence_length: 512
40
+ max_train_steps: 700
41
+ mixed_precision: bf16
42
+ mode_scale: 1.29
43
+ num_class_images: 100
44
+ num_new_tokens_per_abstraction: null
45
+ num_train_epochs: 234
46
+ num_validation_images: 4
47
+ optimizer: prodigy
48
+ output_dir: 3d-icon-Flux-LoRA
49
+ pretrained_model_name_or_path: black-forest-labs/FLUX.1-dev
50
+ prior_generation_precision: null
51
+ prior_loss_weight: 1.0
52
+ prodigy_beta3: null
53
+ prodigy_decouple: true
54
+ prodigy_safeguard_warmup: true
55
+ prodigy_use_bias_correction: true
56
+ push_to_hub: false
57
+ random_flip: false
58
+ rank: 8
59
+ repeats: 1
60
+ report_to: tensorboard
61
+ resolution: 1024
62
+ resume_from_checkpoint: null
63
+ revision: null
64
+ sample_batch_size: 4
65
+ scale_lr: false
66
+ seed: 0
67
+ text_encoder_lr: 1.0
68
+ token_abstraction: TOK
69
+ train_batch_size: 1
70
+ train_text_encoder: false
71
+ train_text_encoder_frac: 1.0
72
+ train_text_encoder_ti: true
73
+ train_text_encoder_ti_frac: 0.5
74
+ train_transformer_frac: 1.0
75
+ use_8bit_adam: false
76
+ validation_epochs: 50
77
+ validation_prompt: null
78
+ variant: null
79
+ weighting_scheme: none
80
+ with_prior_preservation: false
logs/dreambooth-flux-dev-lora-advanced/1735574990.5713248/events.out.tfevents.1735574990.gpuserver-14.860016.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9f38568834461fa70f2ccf48726401e363966bbdcaab7a0fa3fd3c23f005595a
3
+ size 3586
logs/dreambooth-flux-dev-lora-advanced/1735574990.57511/hparams.yml ADDED
@@ -0,0 +1,80 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ adam_beta1: 0.9
2
+ adam_beta2: 0.999
3
+ adam_epsilon: 1.0e-08
4
+ adam_weight_decay: 0.0001
5
+ adam_weight_decay_text_encoder: 0.001
6
+ allow_tf32: false
7
+ cache_dir: null
8
+ cache_latents: false
9
+ caption_column: prompt
10
+ center_crop: false
11
+ checkpointing_steps: 2000
12
+ checkpoints_total_limit: null
13
+ class_data_dir: null
14
+ class_prompt: null
15
+ dataloader_num_workers: 0
16
+ dataset_config_name: null
17
+ dataset_name: ./3d_icon
18
+ enable_t5_ti: false
19
+ gradient_accumulation_steps: 1
20
+ gradient_checkpointing: true
21
+ guidance_scale: 3.5
22
+ hub_model_id: null
23
+ hub_token: null
24
+ image_column: image
25
+ initializer_concept: null
26
+ instance_data_dir: null
27
+ instance_prompt: 3d icon in the style of <s0><s1>
28
+ learning_rate: 1.0
29
+ local_rank: 0
30
+ logging_dir: logs
31
+ logit_mean: 0.0
32
+ logit_std: 1.0
33
+ lora_layers: null
34
+ lr_num_cycles: 1
35
+ lr_power: 1.0
36
+ lr_scheduler: constant
37
+ lr_warmup_steps: 0
38
+ max_grad_norm: 1.0
39
+ max_sequence_length: 512
40
+ max_train_steps: 700
41
+ mixed_precision: bf16
42
+ mode_scale: 1.29
43
+ num_class_images: 100
44
+ num_new_tokens_per_abstraction: null
45
+ num_train_epochs: 234
46
+ num_validation_images: 4
47
+ optimizer: prodigy
48
+ output_dir: 3d-icon-Flux-LoRA
49
+ pretrained_model_name_or_path: black-forest-labs/FLUX.1-dev
50
+ prior_generation_precision: null
51
+ prior_loss_weight: 1.0
52
+ prodigy_beta3: null
53
+ prodigy_decouple: true
54
+ prodigy_safeguard_warmup: true
55
+ prodigy_use_bias_correction: true
56
+ push_to_hub: false
57
+ random_flip: false
58
+ rank: 8
59
+ repeats: 1
60
+ report_to: tensorboard
61
+ resolution: 1024
62
+ resume_from_checkpoint: null
63
+ revision: null
64
+ sample_batch_size: 4
65
+ scale_lr: false
66
+ seed: 0
67
+ text_encoder_lr: 1.0
68
+ token_abstraction: TOK
69
+ train_batch_size: 1
70
+ train_text_encoder: false
71
+ train_text_encoder_frac: 1.0
72
+ train_text_encoder_ti: true
73
+ train_text_encoder_ti_frac: 0.5
74
+ train_transformer_frac: 1.0
75
+ use_8bit_adam: false
76
+ validation_epochs: 50
77
+ validation_prompt: null
78
+ variant: null
79
+ weighting_scheme: none
80
+ with_prior_preservation: false
logs/dreambooth-flux-dev-lora-advanced/1735610269.231504/events.out.tfevents.1735610269.gpuserver-14.871398.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3f63914a5f15740cdc5e4d0b4e2df9f5d68fc78e27c4c1cede075837cd53143f
3
+ size 3586
logs/dreambooth-flux-dev-lora-advanced/1735610269.2359283/hparams.yml ADDED
@@ -0,0 +1,80 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ adam_beta1: 0.9
2
+ adam_beta2: 0.999
3
+ adam_epsilon: 1.0e-08
4
+ adam_weight_decay: 0.0001
5
+ adam_weight_decay_text_encoder: 0.001
6
+ allow_tf32: false
7
+ cache_dir: null
8
+ cache_latents: false
9
+ caption_column: prompt
10
+ center_crop: false
11
+ checkpointing_steps: 2000
12
+ checkpoints_total_limit: null
13
+ class_data_dir: null
14
+ class_prompt: null
15
+ dataloader_num_workers: 0
16
+ dataset_config_name: null
17
+ dataset_name: ./3d_icon
18
+ enable_t5_ti: false
19
+ gradient_accumulation_steps: 1
20
+ gradient_checkpointing: true
21
+ guidance_scale: 3.5
22
+ hub_model_id: null
23
+ hub_token: null
24
+ image_column: image
25
+ initializer_concept: null
26
+ instance_data_dir: null
27
+ instance_prompt: 3d icon in the style of <s0><s1>
28
+ learning_rate: 1.0
29
+ local_rank: 0
30
+ logging_dir: logs
31
+ logit_mean: 0.0
32
+ logit_std: 1.0
33
+ lora_layers: null
34
+ lr_num_cycles: 1
35
+ lr_power: 1.0
36
+ lr_scheduler: constant
37
+ lr_warmup_steps: 0
38
+ max_grad_norm: 1.0
39
+ max_sequence_length: 512
40
+ max_train_steps: 700
41
+ mixed_precision: bf16
42
+ mode_scale: 1.29
43
+ num_class_images: 100
44
+ num_new_tokens_per_abstraction: null
45
+ num_train_epochs: 234
46
+ num_validation_images: 4
47
+ optimizer: prodigy
48
+ output_dir: 3d-icon-Flux-LoRA
49
+ pretrained_model_name_or_path: black-forest-labs/FLUX.1-dev
50
+ prior_generation_precision: null
51
+ prior_loss_weight: 1.0
52
+ prodigy_beta3: null
53
+ prodigy_decouple: true
54
+ prodigy_safeguard_warmup: true
55
+ prodigy_use_bias_correction: true
56
+ push_to_hub: true
57
+ random_flip: false
58
+ rank: 8
59
+ repeats: 1
60
+ report_to: tensorboard
61
+ resolution: 1024
62
+ resume_from_checkpoint: null
63
+ revision: null
64
+ sample_batch_size: 4
65
+ scale_lr: false
66
+ seed: 0
67
+ text_encoder_lr: 1.0
68
+ token_abstraction: TOK
69
+ train_batch_size: 1
70
+ train_text_encoder: false
71
+ train_text_encoder_frac: 1.0
72
+ train_text_encoder_ti: true
73
+ train_text_encoder_ti_frac: 0.5
74
+ train_transformer_frac: 1.0
75
+ use_8bit_adam: false
76
+ validation_epochs: 50
77
+ validation_prompt: null
78
+ variant: null
79
+ weighting_scheme: none
80
+ with_prior_preservation: false
logs/dreambooth-flux-dev-lora-advanced/1735610525.572426/events.out.tfevents.1735610525.gpuserver-14.873358.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2f2eefa4731254991c06c363a5e23e02621dced61e0e90ecd6b57dccd3120e1f
3
+ size 3586
logs/dreambooth-flux-dev-lora-advanced/1735610525.5761664/hparams.yml ADDED
@@ -0,0 +1,80 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ adam_beta1: 0.9
2
+ adam_beta2: 0.999
3
+ adam_epsilon: 1.0e-08
4
+ adam_weight_decay: 0.0001
5
+ adam_weight_decay_text_encoder: 0.001
6
+ allow_tf32: false
7
+ cache_dir: null
8
+ cache_latents: false
9
+ caption_column: prompt
10
+ center_crop: false
11
+ checkpointing_steps: 2000
12
+ checkpoints_total_limit: null
13
+ class_data_dir: null
14
+ class_prompt: null
15
+ dataloader_num_workers: 0
16
+ dataset_config_name: null
17
+ dataset_name: ./3d_icon
18
+ enable_t5_ti: false
19
+ gradient_accumulation_steps: 1
20
+ gradient_checkpointing: true
21
+ guidance_scale: 3.5
22
+ hub_model_id: null
23
+ hub_token: null
24
+ image_column: image
25
+ initializer_concept: null
26
+ instance_data_dir: null
27
+ instance_prompt: 3d icon in the style of <s0><s1>
28
+ learning_rate: 1.0
29
+ local_rank: 0
30
+ logging_dir: logs
31
+ logit_mean: 0.0
32
+ logit_std: 1.0
33
+ lora_layers: null
34
+ lr_num_cycles: 1
35
+ lr_power: 1.0
36
+ lr_scheduler: constant
37
+ lr_warmup_steps: 0
38
+ max_grad_norm: 1.0
39
+ max_sequence_length: 512
40
+ max_train_steps: 5
41
+ mixed_precision: bf16
42
+ mode_scale: 1.29
43
+ num_class_images: 100
44
+ num_new_tokens_per_abstraction: null
45
+ num_train_epochs: 2
46
+ num_validation_images: 4
47
+ optimizer: prodigy
48
+ output_dir: 3d-icon-Flux-LoRA
49
+ pretrained_model_name_or_path: black-forest-labs/FLUX.1-dev
50
+ prior_generation_precision: null
51
+ prior_loss_weight: 1.0
52
+ prodigy_beta3: null
53
+ prodigy_decouple: true
54
+ prodigy_safeguard_warmup: true
55
+ prodigy_use_bias_correction: true
56
+ push_to_hub: true
57
+ random_flip: false
58
+ rank: 8
59
+ repeats: 1
60
+ report_to: tensorboard
61
+ resolution: 1024
62
+ resume_from_checkpoint: null
63
+ revision: null
64
+ sample_batch_size: 4
65
+ scale_lr: false
66
+ seed: 0
67
+ text_encoder_lr: 1.0
68
+ token_abstraction: TOK
69
+ train_batch_size: 1
70
+ train_text_encoder: false
71
+ train_text_encoder_frac: 1.0
72
+ train_text_encoder_ti: true
73
+ train_text_encoder_ti_frac: 0.5
74
+ train_transformer_frac: 1.0
75
+ use_8bit_adam: false
76
+ validation_epochs: 50
77
+ validation_prompt: null
78
+ variant: null
79
+ weighting_scheme: none
80
+ with_prior_preservation: false
logs/dreambooth-flux-dev-lora-advanced/events.out.tfevents.1735568051.gpuserver-14.827835.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dbaa4b62918e234554909c271da4b67b9103fc4b88370655a6e73241db8f2633
3
+ size 88
logs/dreambooth-flux-dev-lora-advanced/events.out.tfevents.1735568916.gpuserver-14.831807.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:73de4fc2c2369f35f59ebdae2db5480bd8837d5f3b415c0f415c2f1bf6994aee
3
+ size 88
logs/dreambooth-flux-dev-lora-advanced/events.out.tfevents.1735569547.gpuserver-14.835448.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5364d7c241264d042c348511fd634541bbac2b323adefdf3c54af9dc57557af6
3
+ size 88
logs/dreambooth-flux-dev-lora-advanced/events.out.tfevents.1735569786.gpuserver-14.837421.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:13ee3e1bbf2b089dd4b1ef9604870d4a8e978689d9bb1bd37cca934a86d54d17
3
+ size 88
logs/dreambooth-flux-dev-lora-advanced/events.out.tfevents.1735570108.gpuserver-14.840330.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:73358c34af7023b1def45a37b179822bbac74c4e072c225acd2e785130488abf
3
+ size 88
logs/dreambooth-flux-dev-lora-advanced/events.out.tfevents.1735570348.gpuserver-14.841662.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:53be1dfd27fcccb72eb38ae9de1c85d7d12a42028467a15ca4cf2b58e1b5def3
3
+ size 88
logs/dreambooth-flux-dev-lora-advanced/events.out.tfevents.1735570748.gpuserver-14.843533.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b2f239e2e322a11ef4d99f343fe5399565acb4688c90927ae9dcca71cb2b5088
3
+ size 88
logs/dreambooth-flux-dev-lora-advanced/events.out.tfevents.1735574460.gpuserver-14.856866.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:894ca16a63e53486d7021cb2594ea4ebca0ad1c9321f8985b10d61ce45c9fa3b
3
+ size 88
logs/dreambooth-flux-dev-lora-advanced/events.out.tfevents.1735574668.gpuserver-14.858252.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f0d81ad700a14d41556c60f6c2968eeb7228f3ab70d01a0e0b14d7ebb7ff5a16
3
+ size 88
logs/dreambooth-flux-dev-lora-advanced/events.out.tfevents.1735574990.gpuserver-14.860016.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:73fc0ac488d9442a3f37bb839ce1504144995b812ac2bdb32ca86e132cd04d64
3
+ size 58634
logs/dreambooth-flux-dev-lora-advanced/events.out.tfevents.1735610269.gpuserver-14.871398.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:399e522316f50533570c96e1c12f02cea700de0740383af1e24994dca3c656be
3
+ size 2302
logs/dreambooth-flux-dev-lora-advanced/events.out.tfevents.1735610525.gpuserver-14.873358.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7684ee9cd7d93ed898e29f259b65613c15ebae80f42d368813de31deb747edbc
3
+ size 498
pytorch_lora_weights.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6a6eb50ffb9740f1480ca88be89108f6103f62e541a484617b691187894833ca
3
+ size 44917720