File size: 25,158 Bytes
394336b
 
6c82de3
394336b
 
 
 
 
 
 
 
 
 
 
 
 
 
6c82de3
394336b
6c82de3
 
 
394336b
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
6c82de3
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
394336b
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
---
library_name: transformers
base_model: Arthur-Tsai/histv4_pretrain_smlm
tags:
- generated_from_trainer
metrics:
- accuracy
model-index:
- name: histv4_ftis_pretrain_smlm
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# histv4_ftis_pretrain_smlm

This model is a fine-tuned version of [Arthur-Tsai/histv4_pretrain_smlm](https://huggingface.co/Arthur-Tsai/histv4_pretrain_smlm) on an unknown dataset.
It achieves the following results on the evaluation set:
- Loss: 0.8107
- Accuracy: 0.9403
- Macro F1: 0.8477

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 0.0001
- train_batch_size: 8
- eval_batch_size: 4
- seed: 42
- optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
- lr_scheduler_type: linear
- lr_scheduler_warmup_steps: 6731
- training_steps: 134625

### Training results

| Training Loss | Epoch    | Step  | Validation Loss | Accuracy | Macro F1 |
|:-------------:|:--------:|:-----:|:---------------:|:--------:|:--------:|
| 41.5551       | 0.0010   | 134   | 23.5263         | 0.0544   | 0.0272   |
| 16.2558       | 1.0010   | 268   | 8.7211          | 0.1802   | 0.0537   |
| 6.9342        | 2.0010   | 402   | 6.4634          | 0.5184   | 0.1220   |
| 5.9178        | 3.0010   | 536   | 5.1432          | 0.5568   | 0.1404   |
| 5.201         | 4.0010   | 670   | 4.8583          | 0.5807   | 0.1479   |
| 4.7006        | 5.0010   | 804   | 4.0314          | 0.5984   | 0.1548   |
| 4.2736        | 6.0010   | 938   | 3.4220          | 0.6089   | 0.1647   |
| 3.8421        | 7.0009   | 1072  | 3.0184          | 0.6234   | 0.1776   |
| 3.2177        | 8.0009   | 1206  | 2.7418          | 0.6212   | 0.1735   |
| 3.0887        | 9.0009   | 1340  | 2.4012          | 0.6326   | 0.1792   |
| 2.7333        | 10.0009  | 1474  | 2.3004          | 0.6488   | 0.1914   |
| 2.5787        | 11.0009  | 1608  | 2.2017          | 0.6553   | 0.2067   |
| 2.4664        | 12.0009  | 1742  | 2.0509          | 0.6689   | 0.2198   |
| 2.3341        | 13.0009  | 1876  | 1.9938          | 0.6728   | 0.2479   |
| 2.131         | 14.0009  | 2010  | 2.0652          | 0.6776   | 0.2446   |
| 2.0956        | 15.0009  | 2144  | 1.8677          | 0.6889   | 0.2751   |
| 2.2169        | 16.0009  | 2278  | 1.8121          | 0.6926   | 0.2824   |
| 1.9588        | 17.0009  | 2412  | 1.8118          | 0.7018   | 0.3110   |
| 1.9699        | 18.0009  | 2546  | 1.7990          | 0.6966   | 0.3193   |
| 1.8866        | 19.0009  | 2680  | 1.6326          | 0.7145   | 0.3412   |
| 1.6753        | 20.0008  | 2814  | 1.6780          | 0.7134   | 0.3435   |
| 1.7359        | 21.0008  | 2948  | 1.6077          | 0.7326   | 0.3548   |
| 1.5679        | 22.0008  | 3082  | 1.3690          | 0.7725   | 0.4050   |
| 1.4809        | 23.0008  | 3216  | 1.4555          | 0.7674   | 0.4124   |
| 1.3325        | 24.0008  | 3350  | 1.3400          | 0.7898   | 0.4263   |
| 1.3643        | 25.0008  | 3484  | 1.3297          | 0.7869   | 0.4563   |
| 1.274         | 26.0008  | 3618  | 1.2339          | 0.8029   | 0.4740   |
| 1.2455        | 27.0008  | 3752  | 1.1572          | 0.8076   | 0.4825   |
| 1.1939        | 28.0008  | 3886  | 1.2200          | 0.8075   | 0.4868   |
| 1.0667        | 29.0008  | 4020  | 1.1408          | 0.8158   | 0.5129   |
| 1.0309        | 30.0008  | 4154  | 1.0759          | 0.8242   | 0.5365   |
| 0.9944        | 31.0008  | 4288  | 1.1034          | 0.8225   | 0.5291   |
| 0.9707        | 32.0008  | 4422  | 1.0481          | 0.8276   | 0.5551   |
| 0.9262        | 33.0008  | 4556  | 1.0645          | 0.8302   | 0.5516   |
| 0.9374        | 34.0007  | 4690  | 0.9864          | 0.8401   | 0.5692   |
| 0.8312        | 35.0007  | 4824  | 1.0473          | 0.8426   | 0.5848   |
| 0.8721        | 36.0007  | 4958  | 0.9661          | 0.8523   | 0.5934   |
| 0.7767        | 37.0007  | 5092  | 0.9365          | 0.8457   | 0.5993   |
| 0.7556        | 38.0007  | 5226  | 0.9342          | 0.8506   | 0.6013   |
| 0.7268        | 39.0007  | 5360  | 0.9538          | 0.8563   | 0.5919   |
| 0.6446        | 40.0007  | 5494  | 0.8707          | 0.8673   | 0.6246   |
| 0.6231        | 41.0007  | 5628  | 0.8759          | 0.8631   | 0.6210   |
| 0.5897        | 42.0007  | 5762  | 0.9076          | 0.8694   | 0.6320   |
| 0.5714        | 43.0007  | 5896  | 0.9501          | 0.8567   | 0.6286   |
| 0.598         | 44.0007  | 6030  | 1.0102          | 0.8491   | 0.6329   |
| 0.5199        | 45.0007  | 6164  | 0.8747          | 0.8757   | 0.6491   |
| 0.5363        | 46.0007  | 6298  | 0.8333          | 0.8725   | 0.6515   |
| 0.5191        | 47.0006  | 6432  | 0.9014          | 0.8717   | 0.6571   |
| 0.4919        | 48.0006  | 6566  | 0.9997          | 0.8581   | 0.6336   |
| 0.4623        | 49.0006  | 6700  | 0.8609          | 0.8793   | 0.6605   |
| 0.4495        | 50.0006  | 6834  | 0.8148          | 0.8808   | 0.6749   |
| 0.4388        | 51.0006  | 6968  | 0.9222          | 0.8722   | 0.6622   |
| 0.4272        | 52.0006  | 7102  | 0.9723          | 0.8688   | 0.6609   |
| 0.3909        | 53.0006  | 7236  | 0.7780          | 0.8886   | 0.6889   |
| 0.3846        | 54.0006  | 7370  | 0.8528          | 0.8855   | 0.6834   |
| 0.3653        | 55.0006  | 7504  | 0.7721          | 0.8926   | 0.6973   |
| 0.3885        | 56.0006  | 7638  | 0.7939          | 0.8934   | 0.6943   |
| 0.3468        | 57.0006  | 7772  | 0.7859          | 0.8946   | 0.7011   |
| 0.3341        | 58.0006  | 7906  | 0.7899          | 0.8885   | 0.6989   |
| 0.3416        | 59.0006  | 8040  | 0.7807          | 0.8947   | 0.7031   |
| 0.279         | 60.0005  | 8174  | 0.7811          | 0.8943   | 0.7118   |
| 0.301         | 61.0005  | 8308  | 0.8019          | 0.8912   | 0.6952   |
| 0.3008        | 62.0005  | 8442  | 0.7605          | 0.8967   | 0.7143   |
| 0.292         | 63.0005  | 8576  | 0.7776          | 0.8977   | 0.7150   |
| 0.285         | 64.0005  | 8710  | 0.8281          | 0.8943   | 0.7087   |
| 0.2631        | 65.0005  | 8844  | 0.8047          | 0.9035   | 0.7263   |
| 0.2593        | 66.0005  | 8978  | 0.7932          | 0.8993   | 0.7246   |
| 0.242         | 67.0005  | 9112  | 0.7740          | 0.9039   | 0.7298   |
| 0.2665        | 68.0005  | 9246  | 0.7261          | 0.9027   | 0.7325   |
| 0.2534        | 69.0005  | 9380  | 0.8071          | 0.9040   | 0.7329   |
| 0.2205        | 70.0005  | 9514  | 0.7483          | 0.9097   | 0.7411   |
| 0.2538        | 71.0005  | 9648  | 0.7166          | 0.9111   | 0.7388   |
| 0.223         | 72.0005  | 9782  | 0.7492          | 0.9100   | 0.7455   |
| 0.2131        | 73.0005  | 9916  | 0.7118          | 0.9126   | 0.7507   |
| 0.1985        | 74.0004  | 10050 | 0.6889          | 0.9079   | 0.7453   |
| 0.1967        | 75.0004  | 10184 | 0.7733          | 0.9042   | 0.7486   |
| 0.1911        | 76.0004  | 10318 | 0.7425          | 0.9132   | 0.7515   |
| 0.1917        | 77.0004  | 10452 | 0.7944          | 0.9094   | 0.7509   |
| 0.1907        | 78.0004  | 10586 | 0.7017          | 0.9141   | 0.7560   |
| 0.1806        | 79.0004  | 10720 | 0.7798          | 0.9142   | 0.7561   |
| 0.1897        | 80.0004  | 10854 | 0.7465          | 0.9163   | 0.7587   |
| 0.1771        | 81.0004  | 10988 | 0.7284          | 0.9149   | 0.7596   |
| 0.1654        | 82.0004  | 11122 | 0.8105          | 0.9079   | 0.7535   |
| 0.1562        | 83.0004  | 11256 | 0.7314          | 0.9132   | 0.7605   |
| 0.1809        | 84.0004  | 11390 | 0.6930          | 0.9175   | 0.7625   |
| 0.1709        | 85.0004  | 11524 | 0.7884          | 0.9150   | 0.7654   |
| 0.158         | 86.0004  | 11658 | 0.7529          | 0.9140   | 0.7635   |
| 0.1593        | 87.0003  | 11792 | 0.7558          | 0.9208   | 0.7668   |
| 0.1542        | 88.0003  | 11926 | 0.7057          | 0.9208   | 0.7722   |
| 0.144         | 89.0003  | 12060 | 0.7488          | 0.9183   | 0.7713   |
| 0.1559        | 90.0003  | 12194 | 0.7894          | 0.9160   | 0.7744   |
| 0.1395        | 91.0003  | 12328 | 0.8427          | 0.9142   | 0.7752   |
| 0.1354        | 92.0003  | 12462 | 0.7397          | 0.9158   | 0.7780   |
| 0.1485        | 93.0003  | 12596 | 0.7778          | 0.9196   | 0.7739   |
| 0.145         | 94.0003  | 12730 | 0.7901          | 0.9200   | 0.7789   |
| 0.135         | 95.0003  | 12864 | 0.7491          | 0.9237   | 0.7833   |
| 0.1434        | 96.0003  | 12998 | 0.7421          | 0.9176   | 0.7794   |
| 0.1408        | 97.0003  | 13132 | 0.8034          | 0.9204   | 0.7826   |
| 0.1188        | 98.0003  | 13266 | 0.8200          | 0.9187   | 0.7861   |
| 0.1323        | 99.0003  | 13400 | 0.7874          | 0.9185   | 0.7848   |
| 0.116         | 100.0003 | 13534 | 0.7543          | 0.9221   | 0.7865   |
| 0.1263        | 101.0002 | 13668 | 0.7470          | 0.9250   | 0.7888   |
| 0.1074        | 102.0002 | 13802 | 0.7529          | 0.9219   | 0.7870   |
| 0.1155        | 103.0002 | 13936 | 0.7924          | 0.9241   | 0.7924   |
| 0.124         | 104.0002 | 14070 | 0.7581          | 0.9235   | 0.7877   |
| 0.1146        | 105.0002 | 14204 | 0.7882          | 0.9232   | 0.7955   |
| 0.1155        | 106.0002 | 14338 | 0.8141          | 0.9262   | 0.7934   |
| 0.1187        | 107.0002 | 14472 | 0.6847          | 0.9253   | 0.7929   |
| 0.1113        | 108.0002 | 14606 | 0.7904          | 0.9231   | 0.7911   |
| 0.1079        | 109.0002 | 14740 | 0.7682          | 0.9234   | 0.7915   |
| 0.1114        | 110.0002 | 14874 | 0.7867          | 0.9220   | 0.7914   |
| 0.1134        | 111.0002 | 15008 | 0.7289          | 0.9269   | 0.7949   |
| 0.1099        | 112.0002 | 15142 | 0.7459          | 0.9249   | 0.7970   |
| 0.108         | 113.0002 | 15276 | 0.7593          | 0.9250   | 0.8014   |
| 0.0994        | 114.0001 | 15410 | 0.7299          | 0.9224   | 0.7995   |
| 0.1045        | 115.0001 | 15544 | 0.7006          | 0.9271   | 0.8025   |
| 0.1009        | 116.0001 | 15678 | 0.7219          | 0.9271   | 0.7998   |
| 0.1005        | 117.0001 | 15812 | 0.7966          | 0.9275   | 0.8023   |
| 0.0968        | 118.0001 | 15946 | 0.8041          | 0.9241   | 0.8047   |
| 0.1034        | 119.0001 | 16080 | 0.7535          | 0.9277   | 0.8023   |
| 0.0901        | 120.0001 | 16214 | 0.7161          | 0.9284   | 0.8053   |
| 0.0942        | 121.0001 | 16348 | 0.8485          | 0.9263   | 0.8041   |
| 0.1017        | 122.0001 | 16482 | 0.8011          | 0.9247   | 0.8016   |
| 0.1016        | 123.0001 | 16616 | 0.8531          | 0.9271   | 0.8060   |
| 0.0965        | 124.0001 | 16750 | 0.7779          | 0.9262   | 0.8075   |
| 0.1036        | 125.0001 | 16884 | 0.7804          | 0.9268   | 0.8064   |
| 0.0862        | 126.0001 | 17018 | 0.7374          | 0.9292   | 0.8099   |
| 0.0988        | 127.0001 | 17152 | 0.7485          | 0.9258   | 0.8068   |
| 0.1001        | 128.0000 | 17286 | 0.7971          | 0.9291   | 0.8123   |
| 0.0826        | 129.0000 | 17420 | 0.7788          | 0.9300   | 0.8102   |
| 0.0895        | 130.0000 | 17554 | 0.8128          | 0.9273   | 0.8093   |
| 0.086         | 131.0000 | 17688 | 0.6950          | 0.9308   | 0.8135   |
| 0.0834        | 132.0000 | 17822 | 0.7838          | 0.9287   | 0.8114   |
| 0.0847        | 133.0000 | 17956 | 0.8893          | 0.9295   | 0.8104   |
| 0.0837        | 133.0010 | 18090 | 0.7676          | 0.9319   | 0.8132   |
| 0.0811        | 134.0010 | 18224 | 0.7416          | 0.9279   | 0.8130   |
| 0.0783        | 135.0010 | 18358 | 0.7640          | 0.9318   | 0.8146   |
| 0.0881        | 136.0010 | 18492 | 0.8202          | 0.9310   | 0.8129   |
| 0.0807        | 137.0010 | 18626 | 0.8029          | 0.9268   | 0.8103   |
| 0.0901        | 138.0010 | 18760 | 0.8089          | 0.9294   | 0.8118   |
| 0.0881        | 139.0010 | 18894 | 0.8343          | 0.9311   | 0.8106   |
| 0.0794        | 140.0010 | 19028 | 0.8175          | 0.9263   | 0.8096   |
| 0.0831        | 141.0009 | 19162 | 0.7771          | 0.9320   | 0.8150   |
| 0.0802        | 142.0009 | 19296 | 0.8411          | 0.9266   | 0.8109   |
| 0.0756        | 143.0009 | 19430 | 0.7972          | 0.9261   | 0.8096   |
| 0.0775        | 144.0009 | 19564 | 0.8106          | 0.9324   | 0.8163   |
| 0.0791        | 145.0009 | 19698 | 0.7681          | 0.9317   | 0.8173   |
| 0.0828        | 146.0009 | 19832 | 0.8258          | 0.9275   | 0.8170   |
| 0.0776        | 147.0009 | 19966 | 0.8004          | 0.9274   | 0.8133   |
| 0.0835        | 148.0009 | 20100 | 0.7324          | 0.9322   | 0.8187   |
| 0.0746        | 149.0009 | 20234 | 0.7475          | 0.9320   | 0.8241   |
| 0.0692        | 150.0009 | 20368 | 0.8213          | 0.9299   | 0.8163   |
| 0.0754        | 151.0009 | 20502 | 0.9008          | 0.9300   | 0.8177   |
| 0.0787        | 152.0009 | 20636 | 0.7721          | 0.9339   | 0.8203   |
| 0.0701        | 153.0009 | 20770 | 0.7928          | 0.9312   | 0.8187   |
| 0.0851        | 154.0008 | 20904 | 0.7540          | 0.9297   | 0.8163   |
| 0.0733        | 155.0008 | 21038 | 0.7263          | 0.9352   | 0.8241   |
| 0.0775        | 156.0008 | 21172 | 0.7911          | 0.9317   | 0.8200   |
| 0.0697        | 157.0008 | 21306 | 0.8417          | 0.9342   | 0.8267   |
| 0.0845        | 158.0008 | 21440 | 0.8306          | 0.9319   | 0.8214   |
| 0.0706        | 159.0008 | 21574 | 0.8212          | 0.9316   | 0.8233   |
| 0.0692        | 160.0008 | 21708 | 0.8235          | 0.9298   | 0.8200   |
| 0.0778        | 161.0008 | 21842 | 0.8269          | 0.9329   | 0.8225   |
| 0.0869        | 162.0008 | 21976 | 0.8551          | 0.9324   | 0.8219   |
| 0.0662        | 163.0008 | 22110 | 0.8053          | 0.9324   | 0.8228   |
| 0.07          | 164.0008 | 22244 | 0.8416          | 0.9352   | 0.8264   |
| 0.069         | 165.0008 | 22378 | 0.8288          | 0.9342   | 0.8228   |
| 0.0705        | 166.0008 | 22512 | 0.7717          | 0.9339   | 0.8198   |
| 0.0672        | 167.0008 | 22646 | 0.7860          | 0.9355   | 0.8252   |
| 0.0714        | 168.0007 | 22780 | 0.7715          | 0.9353   | 0.8252   |
| 0.0669        | 169.0007 | 22914 | 0.9343          | 0.9330   | 0.8262   |
| 0.0636        | 170.0007 | 23048 | 0.8008          | 0.9304   | 0.8209   |
| 0.0691        | 171.0007 | 23182 | 0.7393          | 0.9316   | 0.8243   |
| 0.0658        | 172.0007 | 23316 | 0.7584          | 0.9328   | 0.8263   |
| 0.0683        | 173.0007 | 23450 | 0.7970          | 0.9320   | 0.8265   |
| 0.0718        | 174.0007 | 23584 | 0.9420          | 0.9332   | 0.8270   |
| 0.0714        | 175.0007 | 23718 | 0.8105          | 0.9336   | 0.8223   |
| 0.0673        | 176.0007 | 23852 | 0.8063          | 0.9315   | 0.8254   |
| 0.0685        | 177.0007 | 23986 | 0.8507          | 0.9324   | 0.8232   |
| 0.0672        | 178.0007 | 24120 | 0.8262          | 0.9354   | 0.8296   |
| 0.0666        | 179.0007 | 24254 | 0.8841          | 0.9358   | 0.8272   |
| 0.0623        | 180.0007 | 24388 | 0.8183          | 0.9354   | 0.8235   |
| 0.0616        | 181.0006 | 24522 | 0.7900          | 0.9350   | 0.8220   |
| 0.0625        | 182.0006 | 24656 | 0.7423          | 0.9360   | 0.8282   |
| 0.059         | 183.0006 | 24790 | 0.7458          | 0.9327   | 0.8281   |
| 0.0586        | 184.0006 | 24924 | 0.8024          | 0.9353   | 0.8282   |
| 0.0613        | 185.0006 | 25058 | 0.8241          | 0.9369   | 0.8297   |
| 0.0637        | 186.0006 | 25192 | 0.7518          | 0.9345   | 0.8327   |
| 0.0724        | 187.0006 | 25326 | 0.8642          | 0.9331   | 0.8256   |
| 0.0664        | 188.0006 | 25460 | 0.8348          | 0.9344   | 0.8317   |
| 0.0592        | 189.0006 | 25594 | 0.7909          | 0.9362   | 0.8312   |
| 0.0659        | 190.0006 | 25728 | 0.7717          | 0.9373   | 0.8328   |
| 0.0662        | 191.0006 | 25862 | 0.7877          | 0.9367   | 0.8308   |
| 0.0569        | 192.0006 | 25996 | 0.7889          | 0.9334   | 0.8325   |
| 0.0681        | 193.0006 | 26130 | 0.8186          | 0.9332   | 0.8280   |
| 0.0625        | 194.0005 | 26264 | 0.8294          | 0.9338   | 0.8287   |
| 0.0586        | 195.0005 | 26398 | 0.8620          | 0.9330   | 0.8279   |
| 0.0591        | 196.0005 | 26532 | 0.7812          | 0.9334   | 0.8297   |
| 0.0562        | 197.0005 | 26666 | 0.8911          | 0.9327   | 0.8291   |
| 0.0537        | 198.0005 | 26800 | 0.8063          | 0.9335   | 0.8324   |
| 0.0653        | 199.0005 | 26934 | 0.7315          | 0.9355   | 0.8354   |
| 0.0586        | 200.0005 | 27068 | 0.8556          | 0.9358   | 0.8360   |
| 0.0662        | 201.0005 | 27202 | 0.7125          | 0.9357   | 0.8332   |
| 0.0544        | 202.0005 | 27336 | 0.7896          | 0.9375   | 0.8347   |
| 0.058         | 203.0005 | 27470 | 0.7741          | 0.9346   | 0.8331   |
| 0.0569        | 204.0005 | 27604 | 0.8569          | 0.9358   | 0.8327   |
| 0.0541        | 205.0005 | 27738 | 0.8176          | 0.9360   | 0.8341   |
| 0.0639        | 206.0005 | 27872 | 0.8133          | 0.9347   | 0.8314   |
| 0.0544        | 207.0005 | 28006 | 0.8501          | 0.9379   | 0.8380   |
| 0.056         | 208.0004 | 28140 | 0.7397          | 0.9357   | 0.8334   |
| 0.0605        | 209.0004 | 28274 | 0.8294          | 0.9380   | 0.8344   |
| 0.0598        | 210.0004 | 28408 | 0.8295          | 0.9360   | 0.8314   |
| 0.0621        | 211.0004 | 28542 | 0.9268          | 0.9325   | 0.8285   |
| 0.0638        | 212.0004 | 28676 | 0.7732          | 0.9363   | 0.8370   |
| 0.0652        | 213.0004 | 28810 | 0.8035          | 0.9354   | 0.8364   |
| 0.0623        | 214.0004 | 28944 | 0.7354          | 0.9342   | 0.8313   |
| 0.0601        | 215.0004 | 29078 | 0.8142          | 0.9362   | 0.8346   |
| 0.0487        | 216.0004 | 29212 | 0.8914          | 0.9359   | 0.8362   |
| 0.0522        | 217.0004 | 29346 | 0.8071          | 0.9359   | 0.8349   |
| 0.0509        | 218.0004 | 29480 | 0.8832          | 0.9365   | 0.8364   |
| 0.059         | 219.0004 | 29614 | 0.9041          | 0.9349   | 0.8338   |
| 0.0548        | 220.0004 | 29748 | 0.7905          | 0.9387   | 0.8374   |
| 0.0615        | 221.0003 | 29882 | 0.9597          | 0.9338   | 0.8348   |
| 0.0539        | 222.0003 | 30016 | 0.8774          | 0.9338   | 0.8349   |
| 0.0558        | 223.0003 | 30150 | 0.7731          | 0.9358   | 0.8342   |
| 0.0627        | 224.0003 | 30284 | 0.7959          | 0.9410   | 0.8400   |
| 0.0515        | 225.0003 | 30418 | 0.9352          | 0.9356   | 0.8396   |
| 0.0519        | 226.0003 | 30552 | 0.8323          | 0.9339   | 0.8364   |
| 0.058         | 227.0003 | 30686 | 0.8642          | 0.9330   | 0.8365   |
| 0.0556        | 228.0003 | 30820 | 0.9974          | 0.9284   | 0.8343   |
| 0.0537        | 229.0003 | 30954 | 0.7829          | 0.9356   | 0.8361   |
| 0.0545        | 230.0003 | 31088 | 0.7687          | 0.9375   | 0.8351   |
| 0.0493        | 231.0003 | 31222 | 0.8174          | 0.9381   | 0.8359   |
| 0.0509        | 232.0003 | 31356 | 0.8749          | 0.9352   | 0.8365   |
| 0.0578        | 233.0003 | 31490 | 0.8092          | 0.9351   | 0.8389   |
| 0.054         | 234.0003 | 31624 | 0.9021          | 0.9320   | 0.8412   |
| 0.0546        | 235.0002 | 31758 | 0.8734          | 0.9371   | 0.8402   |
| 0.048         | 236.0002 | 31892 | 0.8324          | 0.9379   | 0.8424   |
| 0.0501        | 237.0002 | 32026 | 0.8272          | 0.9366   | 0.8400   |
| 0.0503        | 238.0002 | 32160 | 0.8997          | 0.9369   | 0.8430   |
| 0.047         | 239.0002 | 32294 | 0.8471          | 0.9380   | 0.8415   |
| 0.0449        | 240.0002 | 32428 | 0.8074          | 0.9359   | 0.8373   |
| 0.0485        | 241.0002 | 32562 | 0.8875          | 0.9318   | 0.8347   |
| 0.0546        | 242.0002 | 32696 | 0.7826          | 0.9346   | 0.8399   |
| 0.0601        | 243.0002 | 32830 | 0.8505          | 0.9390   | 0.8397   |
| 0.0485        | 244.0002 | 32964 | 0.8046          | 0.9395   | 0.8439   |
| 0.0536        | 245.0002 | 33098 | 0.8315          | 0.9372   | 0.8416   |
| 0.0463        | 246.0002 | 33232 | 0.8194          | 0.9383   | 0.8418   |
| 0.0536        | 247.0002 | 33366 | 0.8217          | 0.9375   | 0.8385   |
| 0.0461        | 248.0001 | 33500 | 0.7930          | 0.9388   | 0.8389   |
| 0.0487        | 249.0001 | 33634 | 0.8873          | 0.9390   | 0.8381   |
| 0.0603        | 250.0001 | 33768 | 0.7746          | 0.9331   | 0.8330   |
| 0.051         | 251.0001 | 33902 | 0.8490          | 0.9340   | 0.8359   |
| 0.0498        | 252.0001 | 34036 | 0.8098          | 0.9395   | 0.8417   |
| 0.0466        | 253.0001 | 34170 | 0.8295          | 0.9388   | 0.8410   |
| 0.0497        | 254.0001 | 34304 | 0.7591          | 0.9390   | 0.8442   |
| 0.0594        | 255.0001 | 34438 | 0.9901          | 0.9394   | 0.8402   |
| 0.0514        | 256.0001 | 34572 | 0.8113          | 0.9360   | 0.8419   |
| 0.0461        | 257.0001 | 34706 | 0.8267          | 0.9334   | 0.8364   |
| 0.0434        | 258.0001 | 34840 | 0.7760          | 0.9379   | 0.8386   |
| 0.0506        | 259.0001 | 34974 | 0.8669          | 0.9382   | 0.8408   |
| 0.0471        | 260.0001 | 35108 | 0.7772          | 0.9390   | 0.8402   |
| 0.0486        | 261.0001 | 35242 | 0.8321          | 0.9370   | 0.8405   |
| 0.0518        | 262.0000 | 35376 | 0.9146          | 0.9367   | 0.8392   |
| 0.0413        | 263.0000 | 35510 | 0.8359          | 0.9360   | 0.8413   |
| 0.0457        | 264.0000 | 35644 | 0.8839          | 0.9401   | 0.8442   |
| 0.0456        | 265.0000 | 35778 | 0.8783          | 0.9391   | 0.8431   |
| 0.0458        | 266.0000 | 35912 | 0.8283          | 0.9410   | 0.8461   |
| 0.0494        | 267.0000 | 36046 | 0.8519          | 0.9373   | 0.8374   |
| 0.0529        | 267.0010 | 36180 | 0.8561          | 0.9363   | 0.8440   |
| 0.0412        | 268.0010 | 36314 | 0.9018          | 0.9403   | 0.8450   |
| 0.0529        | 269.0010 | 36448 | 0.8497          | 0.9356   | 0.8282   |
| 0.0505        | 270.0010 | 36582 | 0.8640          | 0.9365   | 0.8379   |
| 0.0461        | 271.0010 | 36716 | 0.7976          | 0.9393   | 0.8413   |
| 0.0517        | 272.0010 | 36850 | 0.8718          | 0.9346   | 0.8372   |
| 0.0467        | 273.0010 | 36984 | 0.8357          | 0.9361   | 0.8399   |
| 0.0439        | 274.0010 | 37118 | 0.8862          | 0.9382   | 0.8425   |
| 0.0451        | 275.0009 | 37252 | 0.8501          | 0.9379   | 0.8431   |
| 0.047         | 276.0009 | 37386 | 0.7937          | 0.9384   | 0.8417   |
| 0.0495        | 277.0009 | 37520 | 0.8400          | 0.9368   | 0.8382   |
| 0.0463        | 278.0009 | 37654 | 0.7838          | 0.9355   | 0.8373   |
| 0.0489        | 279.0009 | 37788 | 0.8209          | 0.9400   | 0.8430   |
| 0.0442        | 280.0009 | 37922 | 0.8982          | 0.9344   | 0.8431   |
| 0.0495        | 281.0009 | 38056 | 0.7733          | 0.9387   | 0.8428   |
| 0.0414        | 282.0009 | 38190 | 0.8784          | 0.9394   | 0.8442   |
| 0.0392        | 283.0009 | 38324 | 0.9188          | 0.9371   | 0.8427   |
| 0.0431        | 284.0009 | 38458 | 0.8236          | 0.9404   | 0.8493   |
| 0.0487        | 285.0009 | 38592 | 0.8183          | 0.9396   | 0.8392   |
| 0.0464        | 286.0009 | 38726 | 0.8479          | 0.9374   | 0.8434   |
| 0.0416        | 287.0009 | 38860 | 0.8527          | 0.9396   | 0.8429   |
| 0.0454        | 288.0008 | 38994 | 0.8712          | 0.9354   | 0.8364   |
| 0.0514        | 289.0008 | 39128 | 0.8558          | 0.9394   | 0.8439   |
| 0.048         | 290.0008 | 39262 | 0.8637          | 0.9370   | 0.8394   |
| 0.0535        | 291.0008 | 39396 | 0.8481          | 0.9382   | 0.8410   |
| 0.048         | 292.0008 | 39530 | 0.8196          | 0.9404   | 0.8455   |
| 0.0406        | 293.0008 | 39664 | 0.8391          | 0.9399   | 0.8464   |
| 0.0473        | 294.0008 | 39798 | 0.8275          | 0.9406   | 0.8451   |
| 0.0468        | 295.0008 | 39932 | 0.7980          | 0.9398   | 0.8484   |
| 0.0419        | 296.0008 | 40066 | 0.8415          | 0.9403   | 0.8483   |
| 0.051         | 297.0008 | 40200 | 0.8705          | 0.9412   | 0.8453   |
| 0.0457        | 298.0008 | 40334 | 0.7646          | 0.9393   | 0.8454   |
| 0.0488        | 299.0008 | 40468 | 0.8858          | 0.9366   | 0.8446   |
| 0.0399        | 300.0008 | 40602 | 0.8592          | 0.9366   | 0.8453   |
| 0.0398        | 301.0008 | 40736 | 0.9023          | 0.9396   | 0.8458   |
| 0.0372        | 302.0007 | 40870 | 0.8517          | 0.9380   | 0.8453   |
| 0.0384        | 303.0007 | 41004 | 0.7671          | 0.9409   | 0.8462   |
| 0.0426        | 304.0007 | 41138 | 0.8307          | 0.9378   | 0.8466   |


### Framework versions

- Transformers 4.46.0
- Pytorch 2.3.1+cu121
- Datasets 2.20.0
- Tokenizers 0.20.1