Hugging Face's logo

bilkultheek
/
Cold-Data-LLama-2-7B

PEFT
TensorBoard
Safetensors
trl
sft
Generated from Trainer
Model card Files
xet
 Metrics Community
bilkultheek commited on
Commit
de615bc
·
verified ·
1 Parent(s): 08c0ae6

Model save

Browse files
Files changed (1) hide show
  1. README.md +4 -4
README.md CHANGED
@@ -36,11 +36,11 @@ More information needed
36
 
37
  The following hyperparameters were used during training:
38
  - learning_rate: 0.01
39
- - train_batch_size: 24
40
- - eval_batch_size: 24
41
  - seed: 42
42
- - gradient_accumulation_steps: 24
43
- - total_train_batch_size: 576
44
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
45
  - lr_scheduler_type: cosine
46
  - lr_scheduler_warmup_ratio: 0.03
 
36
 
37
  The following hyperparameters were used during training:
38
  - learning_rate: 0.01
39
+ - train_batch_size: 16
40
+ - eval_batch_size: 16
41
  - seed: 42
42
+ - gradient_accumulation_steps: 8
43
+ - total_train_batch_size: 128
44
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
45
  - lr_scheduler_type: cosine
46
  - lr_scheduler_warmup_ratio: 0.03