Hugging Face's logo

AntonioTH
/
Layout-finetuned-fr-model-50instances20-100epochs-5e-05lr

Document Question Answering
Transformers
TensorBoard
Safetensors
layoutlmv2
Generated from Trainer
Model card Files
xet
 Metrics Community
AntonioTH commited on
Commit
6426a4c
·
verified ·
1 Parent(s): 1916cb9

End of training

Browse files
Files changed (1) hide show
  1. README.md +188 -0
README.md ADDED
@@ -0,0 +1,188 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: transformers
3
+ license: cc-by-nc-sa-4.0
4
+ base_model: microsoft/layoutxlm-base
5
+ tags:
6
+ - generated_from_trainer
7
+ model-index:
8
+ - name: Layout-finetuned-fr-model-50instances20-100epochs-5e-05lr
9
+ results: []
10
+ ---
11
+
12
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
13
+ should probably proofread and complete it, then remove this comment. -->
14
+
15
+ # Layout-finetuned-fr-model-50instances20-100epochs-5e-05lr
16
+
17
+ This model is a fine-tuned version of [microsoft/layoutxlm-base](https://huggingface.co/microsoft/layoutxlm-base) on an unknown dataset.
18
+ It achieves the following results on the evaluation set:
19
+ - Loss: 0.0000
20
+
21
+ ## Model description
22
+
23
+ More information needed
24
+
25
+ ## Intended uses & limitations
26
+
27
+ More information needed
28
+
29
+ ## Training and evaluation data
30
+
31
+ More information needed
32
+
33
+ ## Training procedure
34
+
35
+ ### Training hyperparameters
36
+
37
+ The following hyperparameters were used during training:
38
+ - learning_rate: 5e-05
39
+ - train_batch_size: 4
40
+ - eval_batch_size: 8
41
+ - seed: 42
42
+ - optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
43
+ - lr_scheduler_type: reduce_lr_on_plateau
44
+ - lr_scheduler_warmup_ratio: 0.06
45
+ - num_epochs: 100
46
+
47
+ ### Training results
48
+
49
+ | Training Loss | Epoch | Step | Validation Loss |
50
+ |:-------------:|:-------:|:----:|:---------------:|
51
+ | 3.3707 | 0.7692 | 10 | 0.8298 |
52
+ | 0.33 | 1.5385 | 20 | 0.0024 |
53
+ | 0.0022 | 2.3077 | 30 | 0.0003 |
54
+ | 0.0814 | 3.0769 | 40 | 0.0002 |
55
+ | 0.0004 | 3.8462 | 50 | 0.0001 |
56
+ | 0.0003 | 4.6154 | 60 | 0.0001 |
57
+ | 0.0002 | 5.3846 | 70 | 0.0001 |
58
+ | 0.0002 | 6.1538 | 80 | 0.0001 |
59
+ | 0.0002 | 6.9231 | 90 | 0.0001 |
60
+ | 0.0002 | 7.6923 | 100 | 0.0001 |
61
+ | 0.0002 | 8.4615 | 110 | 0.0001 |
62
+ | 0.0002 | 9.2308 | 120 | 0.0001 |
63
+ | 0.0001 | 10.0 | 130 | 0.0001 |
64
+ | 0.0001 | 10.7692 | 140 | 0.0001 |
65
+ | 0.0001 | 11.5385 | 150 | 0.0001 |
66
+ | 0.0001 | 12.3077 | 160 | 0.0001 |
67
+ | 0.0001 | 13.0769 | 170 | 0.0001 |
68
+ | 0.0001 | 13.8462 | 180 | 0.0001 |
69
+ | 0.0001 | 14.6154 | 190 | 0.0000 |
70
+ | 0.0001 | 15.3846 | 200 | 0.0000 |
71
+ | 0.0001 | 16.1538 | 210 | 0.0000 |
72
+ | 0.0001 | 16.9231 | 220 | 0.0000 |
73
+ | 0.0001 | 17.6923 | 230 | 0.0000 |
74
+ | 0.0001 | 18.4615 | 240 | 0.0000 |
75
+ | 0.0001 | 19.2308 | 250 | 0.0000 |
76
+ | 0.0001 | 20.0 | 260 | 0.0000 |
77
+ | 0.0001 | 20.7692 | 270 | 0.0000 |
78
+ | 0.0001 | 21.5385 | 280 | 0.0000 |
79
+ | 0.0001 | 22.3077 | 290 | 0.0000 |
80
+ | 0.0001 | 23.0769 | 300 | 0.0000 |
81
+ | 0.0001 | 23.8462 | 310 | 0.0000 |
82
+ | 0.0001 | 24.6154 | 320 | 0.0000 |
83
+ | 0.0001 | 25.3846 | 330 | 0.0000 |
84
+ | 0.0001 | 26.1538 | 340 | 0.0000 |
85
+ | 0.0001 | 26.9231 | 350 | 0.0000 |
86
+ | 0.0001 | 27.6923 | 360 | 0.0000 |
87
+ | 0.0001 | 28.4615 | 370 | 0.0000 |
88
+ | 0.0001 | 29.2308 | 380 | 0.0000 |
89
+ | 0.0001 | 30.0 | 390 | 0.0000 |
90
+ | 0.0001 | 30.7692 | 400 | 0.0000 |
91
+ | 0.0001 | 31.5385 | 410 | 0.0000 |
92
+ | 0.0001 | 32.3077 | 420 | 0.0000 |
93
+ | 0.0001 | 33.0769 | 430 | 0.0000 |
94
+ | 0.0001 | 33.8462 | 440 | 0.0000 |
95
+ | 0.0001 | 34.6154 | 450 | 0.0000 |
96
+ | 0.0001 | 35.3846 | 460 | 0.0000 |
97
+ | 0.0001 | 36.1538 | 470 | 0.0000 |
98
+ | 0.0 | 36.9231 | 480 | 0.0000 |
99
+ | 0.0 | 37.6923 | 490 | 0.0000 |
100
+ | 0.0 | 38.4615 | 500 | 0.0000 |
101
+ | 0.0 | 39.2308 | 510 | 0.0000 |
102
+ | 0.0 | 40.0 | 520 | 0.0000 |
103
+ | 0.0 | 40.7692 | 530 | 0.0000 |
104
+ | 0.0 | 41.5385 | 540 | 0.0000 |
105
+ | 0.0 | 42.3077 | 550 | 0.0000 |
106
+ | 0.0 | 43.0769 | 560 | 0.0000 |
107
+ | 0.0 | 43.8462 | 570 | 0.0000 |
108
+ | 0.0 | 44.6154 | 580 | 0.0000 |
109
+ | 0.0 | 45.3846 | 590 | 0.0000 |
110
+ | 0.0 | 46.1538 | 600 | 0.0000 |
111
+ | 0.0 | 46.9231 | 610 | 0.0000 |
112
+ | 0.0 | 47.6923 | 620 | 0.0000 |
113
+ | 0.0 | 48.4615 | 630 | 0.0000 |
114
+ | 0.0 | 49.2308 | 640 | 0.0000 |
115
+ | 0.0 | 50.0 | 650 | 0.0000 |
116
+ | 0.0 | 50.7692 | 660 | 0.0000 |
117
+ | 0.0 | 51.5385 | 670 | 0.0000 |
118
+ | 0.0 | 52.3077 | 680 | 0.0000 |
119
+ | 0.0 | 53.0769 | 690 | 0.0000 |
120
+ | 0.0 | 53.8462 | 700 | 0.0000 |
121
+ | 0.0 | 54.6154 | 710 | 0.0000 |
122
+ | 0.0 | 55.3846 | 720 | 0.0000 |
123
+ | 0.0 | 56.1538 | 730 | 0.0000 |
124
+ | 0.0 | 56.9231 | 740 | 0.0000 |
125
+ | 0.0 | 57.6923 | 750 | 0.0000 |
126
+ | 0.0 | 58.4615 | 760 | 0.0000 |
127
+ | 0.0 | 59.2308 | 770 | 0.0000 |
128
+ | 0.0 | 60.0 | 780 | 0.0000 |
129
+ | 0.0 | 60.7692 | 790 | 0.0000 |
130
+ | 0.0 | 61.5385 | 800 | 0.0000 |
131
+ | 0.0 | 62.3077 | 810 | 0.0000 |
132
+ | 0.0 | 63.0769 | 820 | 0.0000 |
133
+ | 0.0 | 63.8462 | 830 | 0.0000 |
134
+ | 0.0 | 64.6154 | 840 | 0.0000 |
135
+ | 0.0 | 65.3846 | 850 | 0.0000 |
136
+ | 0.0 | 66.1538 | 860 | 0.0000 |
137
+ | 0.0 | 66.9231 | 870 | 0.0000 |
138
+ | 0.0 | 67.6923 | 880 | 0.0000 |
139
+ | 0.0 | 68.4615 | 890 | 0.0000 |
140
+ | 0.0 | 69.2308 | 900 | 0.0000 |
141
+ | 0.0 | 70.0 | 910 | 0.0000 |
142
+ | 0.0 | 70.7692 | 920 | 0.0000 |
143
+ | 0.0 | 71.5385 | 930 | 0.0000 |
144
+ | 0.0 | 72.3077 | 940 | 0.0000 |
145
+ | 0.0 | 73.0769 | 950 | 0.0000 |
146
+ | 0.0 | 73.8462 | 960 | 0.0000 |
147
+ | 0.0 | 74.6154 | 970 | 0.0000 |
148
+ | 0.0 | 75.3846 | 980 | 0.0000 |
149
+ | 0.0 | 76.1538 | 990 | 0.0000 |
150
+ | 0.0 | 76.9231 | 1000 | 0.0000 |
151
+ | 0.0 | 77.6923 | 1010 | 0.0000 |
152
+ | 0.0 | 78.4615 | 1020 | 0.0000 |
153
+ | 0.0 | 79.2308 | 1030 | 0.0000 |
154
+ | 0.0 | 80.0 | 1040 | 0.0000 |
155
+ | 0.0 | 80.7692 | 1050 | 0.0000 |
156
+ | 0.0 | 81.5385 | 1060 | 0.0000 |
157
+ | 0.0 | 82.3077 | 1070 | 0.0000 |
158
+ | 0.0 | 83.0769 | 1080 | 0.0000 |
159
+ | 0.0 | 83.8462 | 1090 | 0.0000 |
160
+ | 0.0 | 84.6154 | 1100 | 0.0000 |
161
+ | 0.0 | 85.3846 | 1110 | 0.0000 |
162
+ | 0.0 | 86.1538 | 1120 | 0.0000 |
163
+ | 0.0 | 86.9231 | 1130 | 0.0000 |
164
+ | 0.0 | 87.6923 | 1140 | 0.0000 |
165
+ | 0.0 | 88.4615 | 1150 | 0.0000 |
166
+ | 0.0 | 89.2308 | 1160 | 0.0000 |
167
+ | 0.0 | 90.0 | 1170 | 0.0000 |
168
+ | 0.0 | 90.7692 | 1180 | 0.0000 |
169
+ | 0.0 | 91.5385 | 1190 | 0.0000 |
170
+ | 0.0 | 92.3077 | 1200 | 0.0000 |
171
+ | 0.0 | 93.0769 | 1210 | 0.0000 |
172
+ | 0.0 | 93.8462 | 1220 | 0.0000 |
173
+ | 0.0 | 94.6154 | 1230 | 0.0000 |
174
+ | 0.0 | 95.3846 | 1240 | 0.0000 |
175
+ | 0.0 | 96.1538 | 1250 | 0.0000 |
176
+ | 0.0 | 96.9231 | 1260 | 0.0000 |
177
+ | 0.0 | 97.6923 | 1270 | 0.0000 |
178
+ | 0.0 | 98.4615 | 1280 | 0.0000 |
179
+ | 0.0 | 99.2308 | 1290 | 0.0000 |
180
+ | 0.0 | 100.0 | 1300 | 0.0000 |
181
+
182
+
183
+ ### Framework versions
184
+
185
+ - Transformers 4.48.0
186
+ - Pytorch 2.4.1.post100
187
+ - Datasets 3.2.0
188
+ - Tokenizers 0.21.0