File size: 29,608 Bytes
84b46f7
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
---
library_name: transformers
tags:
- generated_from_trainer
metrics:
- accuracy
model-index:
- name: ht-stmini-mean-v5_ftis_noPretrain
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# ht-stmini-mean-v5_ftis_noPretrain

This model is a fine-tuned version of [](https://huggingface.co/) on an unknown dataset.
It achieves the following results on the evaluation set:
- Loss: 2.9646
- Accuracy: 0.8523
- Macro F1: 0.6578

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 0.0001
- train_batch_size: 8
- eval_batch_size: 4
- seed: 42
- optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
- lr_scheduler_type: linear
- lr_scheduler_warmup_steps: 6731
- training_steps: 134625

### Training results

| Training Loss | Epoch    | Step  | Validation Loss | Accuracy | Macro F1 |
|:-------------:|:--------:|:-----:|:---------------:|:--------:|:--------:|
| 39.9484       | 0.0010   | 134   | 35.2499         | 0.0213   | 0.0164   |
| 25.2923       | 1.0010   | 268   | 53.6278         | 0.0341   | 0.0217   |
| 12.4056       | 2.0010   | 402   | 137.1845        | 0.2573   | 0.0881   |
| 7.438         | 3.0010   | 536   | 171.5667        | 0.4811   | 0.1322   |
| 5.9088        | 4.0010   | 670   | 174.8220        | 0.5330   | 0.1405   |
| 5.1618        | 5.0010   | 804   | 150.2932        | 0.5581   | 0.1450   |
| 4.7681        | 6.0010   | 938   | 116.9328        | 0.5775   | 0.1520   |
| 4.2999        | 7.0009   | 1072  | 79.4384         | 0.5882   | 0.1652   |
| 3.5993        | 8.0009   | 1206  | 54.6270         | 0.5979   | 0.1606   |
| 3.4242        | 9.0009   | 1340  | 44.8791         | 0.6012   | 0.1618   |
| 2.9819        | 10.0009  | 1474  | 38.0398         | 0.6103   | 0.1605   |
| 2.8408        | 11.0009  | 1608  | 30.8089         | 0.6126   | 0.1634   |
| 2.7195        | 12.0009  | 1742  | 24.1697         | 0.6149   | 0.1616   |
| 2.6018        | 13.0009  | 1876  | 21.1163         | 0.6100   | 0.1691   |
| 2.4196        | 14.0009  | 2010  | 17.4551         | 0.6135   | 0.1607   |
| 2.4479        | 15.0009  | 2144  | 15.7353         | 0.6217   | 0.1678   |
| 2.5892        | 16.0009  | 2278  | 13.7479         | 0.6244   | 0.1639   |
| 2.411         | 17.0009  | 2412  | 15.4100         | 0.6162   | 0.1687   |
| 2.4509        | 18.0009  | 2546  | 10.9748         | 0.6265   | 0.1683   |
| 2.3876        | 19.0009  | 2680  | 10.0210         | 0.6243   | 0.1666   |
| 2.2744        | 20.0008  | 2814  | 9.1328          | 0.6226   | 0.1699   |
| 2.351         | 21.0008  | 2948  | 8.6256          | 0.6218   | 0.1778   |
| 2.2952        | 22.0008  | 3082  | 7.4691          | 0.6223   | 0.1741   |
| 2.2887        | 23.0008  | 3216  | 8.3557          | 0.6032   | 0.1706   |
| 2.2599        | 24.0008  | 3350  | 7.3543          | 0.6220   | 0.1666   |
| 2.2942        | 25.0008  | 3484  | 6.4722          | 0.6203   | 0.1731   |
| 2.2063        | 26.0008  | 3618  | 6.7939          | 0.6311   | 0.1893   |
| 2.1674        | 27.0008  | 3752  | 5.8000          | 0.6158   | 0.1818   |
| 2.2228        | 28.0008  | 3886  | 6.2514          | 0.6232   | 0.1745   |
| 2.1651        | 29.0008  | 4020  | 5.6197          | 0.6055   | 0.1806   |
| 2.1381        | 30.0008  | 4154  | 5.6238          | 0.6396   | 0.2018   |
| 2.1719        | 31.0008  | 4288  | 6.3707          | 0.6286   | 0.1836   |
| 2.2091        | 32.0008  | 4422  | 5.3530          | 0.6445   | 0.2085   |
| 2.0538        | 33.0008  | 4556  | 4.6029          | 0.6176   | 0.1964   |
| 2.187         | 34.0007  | 4690  | 5.6599          | 0.6444   | 0.2221   |
| 1.9745        | 35.0007  | 4824  | 5.0773          | 0.6546   | 0.2289   |
| 2.0           | 36.0007  | 4958  | 4.2086          | 0.6116   | 0.1986   |
| 1.906         | 37.0007  | 5092  | 3.8438          | 0.6494   | 0.2361   |
| 1.8986        | 38.0007  | 5226  | 4.3384          | 0.6671   | 0.2299   |
| 1.9185        | 39.0007  | 5360  | 3.9224          | 0.6662   | 0.2419   |
| 1.7892        | 40.0007  | 5494  | 3.7778          | 0.6715   | 0.2619   |
| 1.7706        | 41.0007  | 5628  | 4.0030          | 0.6716   | 0.2573   |
| 1.779         | 42.0007  | 5762  | 4.2370          | 0.6783   | 0.2666   |
| 1.7465        | 43.0007  | 5896  | 4.2711          | 0.6798   | 0.2797   |
| 1.6805        | 44.0007  | 6030  | 4.1040          | 0.6755   | 0.2756   |
| 1.5513        | 45.0007  | 6164  | 4.1495          | 0.6797   | 0.2756   |
| 1.6039        | 46.0007  | 6298  | 4.3661          | 0.7106   | 0.2957   |
| 1.5398        | 47.0006  | 6432  | 4.5877          | 0.6715   | 0.2919   |
| 1.6246        | 48.0006  | 6566  | 5.6535          | 0.6988   | 0.2906   |
| 1.4741        | 49.0006  | 6700  | 5.1065          | 0.7067   | 0.3122   |
| 1.4536        | 50.0006  | 6834  | 4.7317          | 0.7132   | 0.3167   |
| 1.4187        | 51.0006  | 6968  | 5.3708          | 0.7229   | 0.3350   |
| 1.2916        | 52.0006  | 7102  | 4.7151          | 0.7083   | 0.3320   |
| 1.3196        | 53.0006  | 7236  | 5.0228          | 0.7197   | 0.3555   |
| 1.2258        | 54.0006  | 7370  | 5.3236          | 0.7316   | 0.3593   |
| 1.2596        | 55.0006  | 7504  | 7.3198          | 0.7326   | 0.3552   |
| 1.2446        | 56.0006  | 7638  | 6.3256          | 0.7463   | 0.3810   |
| 1.1849        | 57.0006  | 7772  | 6.5613          | 0.7424   | 0.3817   |
| 1.1231        | 58.0006  | 7906  | 7.4051          | 0.7438   | 0.3919   |
| 1.1748        | 59.0006  | 8040  | 8.7323          | 0.7188   | 0.3547   |
| 1.0281        | 60.0005  | 8174  | 7.7429          | 0.7511   | 0.4077   |
| 1.0689        | 61.0005  | 8308  | 8.7558          | 0.7480   | 0.4152   |
| 0.9825        | 62.0005  | 8442  | 9.0319          | 0.7568   | 0.3984   |
| 1.0564        | 63.0005  | 8576  | 9.4509          | 0.7502   | 0.4089   |
| 0.988         | 64.0005  | 8710  | 11.7435         | 0.7566   | 0.4226   |
| 0.9066        | 65.0005  | 8844  | 11.5885         | 0.7641   | 0.4457   |
| 0.9019        | 66.0005  | 8978  | 11.3921         | 0.7379   | 0.4164   |
| 0.8292        | 67.0005  | 9112  | 13.8146         | 0.7714   | 0.4331   |
| 0.9522        | 68.0005  | 9246  | 13.8157         | 0.7710   | 0.4476   |
| 0.8317        | 69.0005  | 9380  | 16.6493         | 0.7721   | 0.4622   |
| 0.7857        | 70.0005  | 9514  | 14.0590         | 0.7637   | 0.4439   |
| 0.874         | 71.0005  | 9648  | 16.4763         | 0.7725   | 0.4691   |
| 0.806         | 72.0005  | 9782  | 15.3368         | 0.7764   | 0.4811   |
| 0.7208        | 73.0005  | 9916  | 17.2181         | 0.7848   | 0.4679   |
| 0.7272        | 74.0004  | 10050 | 14.3154         | 0.7718   | 0.4835   |
| 0.7057        | 75.0004  | 10184 | 17.2924         | 0.7603   | 0.4640   |
| 0.7099        | 76.0004  | 10318 | 18.9115         | 0.7764   | 0.4575   |
| 0.7144        | 77.0004  | 10452 | 19.8504         | 0.7725   | 0.4858   |
| 0.6714        | 78.0004  | 10586 | 17.2989         | 0.7815   | 0.4778   |
| 0.6524        | 79.0004  | 10720 | 19.1514         | 0.7790   | 0.5055   |
| 0.6065        | 80.0004  | 10854 | 17.4992         | 0.7850   | 0.5085   |
| 0.6685        | 81.0004  | 10988 | 18.5515         | 0.7799   | 0.5044   |
| 0.6318        | 82.0004  | 11122 | 22.2383         | 0.7852   | 0.4903   |
| 0.5753        | 83.0004  | 11256 | 17.8166         | 0.7734   | 0.4818   |
| 0.6282        | 84.0004  | 11390 | 20.6697         | 0.7819   | 0.5110   |
| 0.5634        | 85.0004  | 11524 | 19.4951         | 0.7913   | 0.5180   |
| 0.5586        | 86.0004  | 11658 | 19.0333         | 0.7984   | 0.5153   |
| 0.5508        | 87.0003  | 11792 | 20.6972         | 0.7867   | 0.5262   |
| 0.5556        | 88.0003  | 11926 | 22.4102         | 0.7899   | 0.5273   |
| 0.5599        | 89.0003  | 12060 | 21.5349         | 0.7880   | 0.5105   |
| 0.55          | 90.0003  | 12194 | 22.8908         | 0.7917   | 0.5251   |
| 0.5363        | 91.0003  | 12328 | 21.5912         | 0.7910   | 0.5332   |
| 0.4754        | 92.0003  | 12462 | 21.5374         | 0.7894   | 0.5341   |
| 0.5252        | 93.0003  | 12596 | 25.5882         | 0.7984   | 0.5340   |
| 0.4714        | 94.0003  | 12730 | 23.1033         | 0.7940   | 0.5078   |
| 0.464         | 95.0003  | 12864 | 24.0546         | 0.7938   | 0.5296   |
| 0.4795        | 96.0003  | 12998 | 21.1376         | 0.7992   | 0.5460   |
| 0.4605        | 97.0003  | 13132 | 21.6739         | 0.8067   | 0.5328   |
| 0.4411        | 98.0003  | 13266 | 20.6091         | 0.8001   | 0.5410   |
| 0.412         | 99.0003  | 13400 | 19.6526         | 0.8067   | 0.5471   |
| 0.4256        | 100.0003 | 13534 | 18.8908         | 0.8071   | 0.5534   |
| 0.4318        | 101.0002 | 13668 | 19.6027         | 0.7968   | 0.5485   |
| 0.3903        | 102.0002 | 13802 | 18.3652         | 0.8005   | 0.5523   |
| 0.4212        | 103.0002 | 13936 | 21.3332         | 0.8108   | 0.5576   |
| 0.3861        | 104.0002 | 14070 | 21.7067         | 0.7997   | 0.5543   |
| 0.3886        | 105.0002 | 14204 | 21.0634         | 0.8098   | 0.5682   |
| 0.3795        | 106.0002 | 14338 | 22.4133         | 0.8071   | 0.5617   |
| 0.377         | 107.0002 | 14472 | 19.8422         | 0.8151   | 0.5671   |
| 0.3689        | 108.0002 | 14606 | 21.4968         | 0.8023   | 0.5587   |
| 0.3401        | 109.0002 | 14740 | 19.3745         | 0.8116   | 0.5670   |
| 0.3619        | 110.0002 | 14874 | 19.8852         | 0.7990   | 0.5542   |
| 0.3136        | 111.0002 | 15008 | 19.9481         | 0.7994   | 0.5600   |
| 0.3301        | 112.0002 | 15142 | 19.4915         | 0.8107   | 0.5738   |
| 0.3517        | 113.0002 | 15276 | 17.8709         | 0.8074   | 0.5663   |
| 0.2993        | 114.0001 | 15410 | 18.7033         | 0.8145   | 0.5726   |
| 0.2967        | 115.0001 | 15544 | 17.9293         | 0.8017   | 0.5695   |
| 0.3105        | 116.0001 | 15678 | 17.5294         | 0.8069   | 0.5662   |
| 0.3226        | 117.0001 | 15812 | 20.8622         | 0.8067   | 0.5696   |
| 0.2886        | 118.0001 | 15946 | 19.2584         | 0.8117   | 0.5704   |
| 0.2918        | 119.0001 | 16080 | 20.0134         | 0.8075   | 0.5736   |
| 0.2805        | 120.0001 | 16214 | 17.7522         | 0.8117   | 0.5807   |
| 0.2834        | 121.0001 | 16348 | 20.3044         | 0.8018   | 0.5671   |
| 0.2537        | 122.0001 | 16482 | 19.4515         | 0.7975   | 0.5458   |
| 0.2654        | 123.0001 | 16616 | 19.5489         | 0.8132   | 0.5739   |
| 0.2506        | 124.0001 | 16750 | 19.3780         | 0.8063   | 0.5655   |
| 0.2634        | 125.0001 | 16884 | 18.7779         | 0.8151   | 0.5762   |
| 0.2567        | 126.0001 | 17018 | 20.0204         | 0.8073   | 0.5635   |
| 0.2222        | 127.0001 | 17152 | 18.9498         | 0.8108   | 0.5827   |
| 0.2462        | 128.0000 | 17286 | 18.4979         | 0.8123   | 0.5821   |
| 0.2295        | 129.0000 | 17420 | 18.1447         | 0.8156   | 0.5826   |
| 0.2198        | 130.0000 | 17554 | 18.5187         | 0.8186   | 0.5811   |
| 0.2116        | 131.0000 | 17688 | 16.7665         | 0.8127   | 0.5856   |
| 0.2211        | 132.0000 | 17822 | 18.5034         | 0.8170   | 0.5908   |
| 0.2298        | 133.0000 | 17956 | 18.8697         | 0.8149   | 0.5879   |
| 0.211         | 133.0010 | 18090 | 15.2352         | 0.8163   | 0.5919   |
| 0.2131        | 134.0010 | 18224 | 18.8907         | 0.8065   | 0.5874   |
| 0.2008        | 135.0010 | 18358 | 15.8912         | 0.8121   | 0.5864   |
| 0.1841        | 136.0010 | 18492 | 17.2753         | 0.8122   | 0.5872   |
| 0.2013        | 137.0010 | 18626 | 16.0174         | 0.8195   | 0.5826   |
| 0.189         | 138.0010 | 18760 | 17.5670         | 0.8181   | 0.5840   |
| 0.1836        | 139.0010 | 18894 | 14.7772         | 0.8085   | 0.5870   |
| 0.2035        | 140.0010 | 19028 | 15.4075         | 0.8123   | 0.5817   |
| 0.1754        | 141.0009 | 19162 | 16.9242         | 0.8177   | 0.5947   |
| 0.172         | 142.0009 | 19296 | 13.6895         | 0.8162   | 0.5868   |
| 0.1728        | 143.0009 | 19430 | 13.2621         | 0.8113   | 0.5909   |
| 0.1621        | 144.0009 | 19564 | 13.0729         | 0.8182   | 0.5946   |
| 0.1606        | 145.0009 | 19698 | 12.9905         | 0.8179   | 0.6015   |
| 0.1649        | 146.0009 | 19832 | 12.6423         | 0.8204   | 0.5891   |
| 0.1562        | 147.0009 | 19966 | 12.6852         | 0.8197   | 0.5987   |
| 0.154         | 148.0009 | 20100 | 14.1863         | 0.8233   | 0.5955   |
| 0.1609        | 149.0009 | 20234 | 14.4083         | 0.8189   | 0.6002   |
| 0.1478        | 150.0009 | 20368 | 12.4198         | 0.8200   | 0.5863   |
| 0.1524        | 151.0009 | 20502 | 12.8797         | 0.8187   | 0.5984   |
| 0.1512        | 152.0009 | 20636 | 12.4956         | 0.8172   | 0.5961   |
| 0.1531        | 153.0009 | 20770 | 12.0234         | 0.8127   | 0.5920   |
| 0.1495        | 154.0008 | 20904 | 12.5771         | 0.8239   | 0.6031   |
| 0.1432        | 155.0008 | 21038 | 11.4251         | 0.8157   | 0.6033   |
| 0.1304        | 156.0008 | 21172 | 12.4493         | 0.8175   | 0.6015   |
| 0.1379        | 157.0008 | 21306 | 13.6643         | 0.8211   | 0.5985   |
| 0.133         | 158.0008 | 21440 | 10.8954         | 0.8233   | 0.6064   |
| 0.1352        | 159.0008 | 21574 | 11.2505         | 0.8231   | 0.6010   |
| 0.1288        | 160.0008 | 21708 | 11.0461         | 0.8174   | 0.5979   |
| 0.1279        | 161.0008 | 21842 | 12.2734         | 0.8250   | 0.6074   |
| 0.1219        | 162.0008 | 21976 | 11.1999         | 0.8169   | 0.5999   |
| 0.1256        | 163.0008 | 22110 | 9.9643          | 0.8178   | 0.6050   |
| 0.1495        | 164.0008 | 22244 | 8.9217          | 0.8193   | 0.5953   |
| 0.1159        | 165.0008 | 22378 | 9.8429          | 0.8248   | 0.6055   |
| 0.1213        | 166.0008 | 22512 | 10.5241         | 0.8306   | 0.6099   |
| 0.1059        | 167.0008 | 22646 | 9.6181          | 0.8235   | 0.6020   |
| 0.1157        | 168.0007 | 22780 | 9.6775          | 0.8248   | 0.6064   |
| 0.1153        | 169.0007 | 22914 | 10.0044         | 0.8226   | 0.6118   |
| 0.1117        | 170.0007 | 23048 | 8.9566          | 0.8266   | 0.6091   |
| 0.1043        | 171.0007 | 23182 | 8.8997          | 0.8305   | 0.6102   |
| 0.1089        | 172.0007 | 23316 | 9.4261          | 0.8210   | 0.6038   |
| 0.1047        | 173.0007 | 23450 | 9.8315          | 0.8230   | 0.6041   |
| 0.1073        | 174.0007 | 23584 | 9.3647          | 0.8217   | 0.6068   |
| 0.1042        | 175.0007 | 23718 | 8.8990          | 0.8204   | 0.6080   |
| 0.0977        | 176.0007 | 23852 | 9.6059          | 0.8255   | 0.6115   |
| 0.0936        | 177.0007 | 23986 | 8.6284          | 0.8268   | 0.6128   |
| 0.093         | 178.0007 | 24120 | 9.2845          | 0.8225   | 0.6119   |
| 0.0957        | 179.0007 | 24254 | 8.0941          | 0.8280   | 0.6098   |
| 0.0867        | 180.0007 | 24388 | 8.1483          | 0.8328   | 0.6167   |
| 0.0887        | 181.0006 | 24522 | 6.9962          | 0.8264   | 0.6050   |
| 0.0945        | 182.0006 | 24656 | 7.4532          | 0.8287   | 0.6102   |
| 0.087         | 183.0006 | 24790 | 7.8841          | 0.8252   | 0.6097   |
| 0.0822        | 184.0006 | 24924 | 7.9621          | 0.8246   | 0.6094   |
| 0.088         | 185.0006 | 25058 | 7.0550          | 0.8271   | 0.6095   |
| 0.0821        | 186.0006 | 25192 | 6.9690          | 0.8206   | 0.6020   |
| 0.0806        | 187.0006 | 25326 | 7.5555          | 0.8282   | 0.6167   |
| 0.0839        | 188.0006 | 25460 | 7.6858          | 0.8252   | 0.6138   |
| 0.0825        | 189.0006 | 25594 | 6.7863          | 0.8326   | 0.6129   |
| 0.0832        | 190.0006 | 25728 | 6.8085          | 0.8285   | 0.6179   |
| 0.0827        | 191.0006 | 25862 | 7.1888          | 0.8291   | 0.6210   |
| 0.0738        | 192.0006 | 25996 | 7.1850          | 0.8359   | 0.6154   |
| 0.0823        | 193.0006 | 26130 | 5.9604          | 0.8289   | 0.6185   |
| 0.0732        | 194.0005 | 26264 | 7.2097          | 0.8273   | 0.6040   |
| 0.0746        | 195.0005 | 26398 | 6.7980          | 0.8285   | 0.6210   |
| 0.0692        | 196.0005 | 26532 | 6.3140          | 0.8333   | 0.6247   |
| 0.0696        | 197.0005 | 26666 | 6.4402          | 0.8324   | 0.6125   |
| 0.0691        | 198.0005 | 26800 | 6.1395          | 0.8276   | 0.6190   |
| 0.0749        | 199.0005 | 26934 | 6.6525          | 0.8319   | 0.6185   |
| 0.0703        | 200.0005 | 27068 | 5.7712          | 0.8269   | 0.6099   |
| 0.0699        | 201.0005 | 27202 | 5.9619          | 0.8331   | 0.6192   |
| 0.0697        | 202.0005 | 27336 | 6.1422          | 0.8282   | 0.6189   |
| 0.0664        | 203.0005 | 27470 | 5.9802          | 0.8296   | 0.6201   |
| 0.0616        | 204.0005 | 27604 | 5.5207          | 0.8350   | 0.6199   |
| 0.0732        | 205.0005 | 27738 | 5.7944          | 0.8315   | 0.6201   |
| 0.0641        | 206.0005 | 27872 | 5.6017          | 0.8323   | 0.6157   |
| 0.0576        | 207.0005 | 28006 | 6.2887          | 0.8235   | 0.6165   |
| 0.0645        | 208.0004 | 28140 | 5.8601          | 0.8338   | 0.6192   |
| 0.0642        | 209.0004 | 28274 | 5.7700          | 0.8355   | 0.6221   |
| 0.0632        | 210.0004 | 28408 | 5.0916          | 0.8332   | 0.6255   |
| 0.0651        | 211.0004 | 28542 | 5.3219          | 0.8300   | 0.6099   |
| 0.0585        | 212.0004 | 28676 | 5.5364          | 0.8331   | 0.6210   |
| 0.0587        | 213.0004 | 28810 | 5.1313          | 0.8316   | 0.6177   |
| 0.0627        | 214.0004 | 28944 | 4.9479          | 0.8352   | 0.6185   |
| 0.0564        | 215.0004 | 29078 | 5.2699          | 0.8349   | 0.6268   |
| 0.0564        | 216.0004 | 29212 | 5.3181          | 0.8352   | 0.6225   |
| 0.0567        | 217.0004 | 29346 | 5.0721          | 0.8266   | 0.6170   |
| 0.0591        | 218.0004 | 29480 | 5.0919          | 0.8380   | 0.6212   |
| 0.054         | 219.0004 | 29614 | 5.0326          | 0.8277   | 0.6210   |
| 0.0533        | 220.0004 | 29748 | 4.5075          | 0.8326   | 0.6185   |
| 0.0608        | 221.0003 | 29882 | 5.1480          | 0.8362   | 0.6154   |
| 0.0691        | 222.0003 | 30016 | 5.1124          | 0.8320   | 0.6215   |
| 0.0503        | 223.0003 | 30150 | 4.6642          | 0.8370   | 0.6268   |
| 0.052         | 224.0003 | 30284 | 4.8534          | 0.8354   | 0.6219   |
| 0.0531        | 225.0003 | 30418 | 4.5935          | 0.8353   | 0.6241   |
| 0.0485        | 226.0003 | 30552 | 4.5605          | 0.8361   | 0.6304   |
| 0.057         | 227.0003 | 30686 | 4.5620          | 0.8351   | 0.6280   |
| 0.0499        | 228.0003 | 30820 | 4.3572          | 0.8340   | 0.6285   |
| 0.0538        | 229.0003 | 30954 | 4.4488          | 0.8379   | 0.6318   |
| 0.0552        | 230.0003 | 31088 | 5.0000          | 0.8356   | 0.6288   |
| 0.0517        | 231.0003 | 31222 | 4.3277          | 0.8336   | 0.6213   |
| 0.0477        | 232.0003 | 31356 | 4.2746          | 0.8407   | 0.6276   |
| 0.0495        | 233.0003 | 31490 | 4.1315          | 0.8393   | 0.6291   |
| 0.0436        | 234.0003 | 31624 | 4.2755          | 0.8363   | 0.6244   |
| 0.0466        | 235.0002 | 31758 | 4.3230          | 0.8411   | 0.6329   |
| 0.0477        | 236.0002 | 31892 | 4.0913          | 0.8390   | 0.6292   |
| 0.0466        | 237.0002 | 32026 | 3.8497          | 0.8401   | 0.6277   |
| 0.0463        | 238.0002 | 32160 | 4.4265          | 0.8387   | 0.6279   |
| 0.044         | 239.0002 | 32294 | 4.3438          | 0.8356   | 0.6288   |
| 0.0427        | 240.0002 | 32428 | 3.9881          | 0.8422   | 0.6338   |
| 0.0432        | 241.0002 | 32562 | 3.8410          | 0.8409   | 0.6360   |
| 0.0474        | 242.0002 | 32696 | 3.8954          | 0.8350   | 0.6238   |
| 0.0478        | 243.0002 | 32830 | 3.8765          | 0.8402   | 0.6318   |
| 0.0488        | 244.0002 | 32964 | 3.8497          | 0.8405   | 0.6347   |
| 0.0422        | 245.0002 | 33098 | 3.5000          | 0.8396   | 0.6297   |
| 0.0445        | 246.0002 | 33232 | 3.9741          | 0.8399   | 0.6297   |
| 0.0402        | 247.0002 | 33366 | 3.9199          | 0.8362   | 0.6283   |
| 0.0379        | 248.0001 | 33500 | 3.7305          | 0.8440   | 0.6351   |
| 0.0417        | 249.0001 | 33634 | 3.8176          | 0.8402   | 0.6310   |
| 0.0412        | 250.0001 | 33768 | 3.7180          | 0.8355   | 0.6299   |
| 0.0399        | 251.0001 | 33902 | 3.6548          | 0.8422   | 0.6334   |
| 0.0398        | 252.0001 | 34036 | 3.7026          | 0.8399   | 0.6343   |
| 0.0383        | 253.0001 | 34170 | 3.6131          | 0.8438   | 0.6376   |
| 0.0387        | 254.0001 | 34304 | 3.7436          | 0.8385   | 0.6350   |
| 0.0364        | 255.0001 | 34438 | 3.7502          | 0.8397   | 0.6333   |
| 0.0375        | 256.0001 | 34572 | 3.3613          | 0.8399   | 0.6385   |
| 0.0417        | 257.0001 | 34706 | 3.6177          | 0.8358   | 0.6269   |
| 0.0391        | 258.0001 | 34840 | 3.5289          | 0.8426   | 0.6295   |
| 0.0375        | 259.0001 | 34974 | 3.6470          | 0.8412   | 0.6376   |
| 0.04          | 260.0001 | 35108 | 3.4957          | 0.8448   | 0.6390   |
| 0.0353        | 261.0001 | 35242 | 3.5731          | 0.8412   | 0.6326   |
| 0.0373        | 262.0000 | 35376 | 3.4997          | 0.8436   | 0.6320   |
| 0.037         | 263.0000 | 35510 | 3.6281          | 0.8411   | 0.6363   |
| 0.0353        | 264.0000 | 35644 | 3.4524          | 0.8433   | 0.6342   |
| 0.0382        | 265.0000 | 35778 | 3.5199          | 0.8423   | 0.6340   |
| 0.0383        | 266.0000 | 35912 | 3.3159          | 0.8397   | 0.6383   |
| 0.0361        | 267.0000 | 36046 | 3.5210          | 0.8362   | 0.6322   |
| 0.0363        | 267.0010 | 36180 | 3.3374          | 0.8456   | 0.6352   |
| 0.0367        | 268.0010 | 36314 | 3.3686          | 0.8448   | 0.6379   |
| 0.0353        | 269.0010 | 36448 | 3.1677          | 0.8476   | 0.6375   |
| 0.0359        | 270.0010 | 36582 | 3.3584          | 0.8430   | 0.6382   |
| 0.0318        | 271.0010 | 36716 | 3.2359          | 0.8418   | 0.6330   |
| 0.0329        | 272.0010 | 36850 | 3.5583          | 0.8436   | 0.6387   |
| 0.0314        | 273.0010 | 36984 | 3.1740          | 0.8430   | 0.6426   |
| 0.0325        | 274.0010 | 37118 | 3.3802          | 0.8438   | 0.6373   |
| 0.0348        | 275.0009 | 37252 | 3.2404          | 0.8452   | 0.6423   |
| 0.0319        | 276.0009 | 37386 | 3.6001          | 0.8485   | 0.6438   |
| 0.0334        | 277.0009 | 37520 | 3.2964          | 0.8444   | 0.6372   |
| 0.031         | 278.0009 | 37654 | 3.4434          | 0.8435   | 0.6279   |
| 0.0299        | 279.0009 | 37788 | 3.0918          | 0.8450   | 0.6372   |
| 0.0335        | 280.0009 | 37922 | 3.4162          | 0.8456   | 0.6414   |
| 0.034         | 281.0009 | 38056 | 3.4431          | 0.8424   | 0.6389   |
| 0.0316        | 282.0009 | 38190 | 3.4383          | 0.8436   | 0.6346   |
| 0.0289        | 283.0009 | 38324 | 3.3247          | 0.8502   | 0.6403   |
| 0.0278        | 284.0009 | 38458 | 3.2105          | 0.8473   | 0.6352   |
| 0.0299        | 285.0009 | 38592 | 3.1715          | 0.8448   | 0.6346   |
| 0.0296        | 286.0009 | 38726 | 3.1941          | 0.8444   | 0.6399   |
| 0.03          | 287.0009 | 38860 | 3.1617          | 0.8436   | 0.6391   |
| 0.0267        | 288.0008 | 38994 | 3.1823          | 0.8438   | 0.6366   |
| 0.0304        | 289.0008 | 39128 | 3.1678          | 0.8469   | 0.6441   |
| 0.0322        | 290.0008 | 39262 | 3.1292          | 0.8447   | 0.6365   |
| 0.0299        | 291.0008 | 39396 | 3.1379          | 0.8502   | 0.6392   |
| 0.028         | 292.0008 | 39530 | 3.1904          | 0.8460   | 0.6387   |
| 0.0255        | 293.0008 | 39664 | 3.0576          | 0.8484   | 0.6426   |
| 0.0294        | 294.0008 | 39798 | 3.0661          | 0.8445   | 0.6437   |
| 0.0276        | 295.0008 | 39932 | 3.1695          | 0.8462   | 0.6353   |
| 0.0277        | 296.0008 | 40066 | 2.9409          | 0.8479   | 0.6460   |
| 0.028         | 297.0008 | 40200 | 3.1881          | 0.8463   | 0.6396   |
| 0.0272        | 298.0008 | 40334 | 3.0840          | 0.8435   | 0.6418   |
| 0.0271        | 299.0008 | 40468 | 3.2019          | 0.8453   | 0.6404   |
| 0.0289        | 300.0008 | 40602 | 3.0667          | 0.8467   | 0.6403   |
| 0.0279        | 301.0008 | 40736 | 2.9892          | 0.8472   | 0.6397   |
| 0.0295        | 302.0007 | 40870 | 2.9842          | 0.8492   | 0.6444   |
| 0.0256        | 303.0007 | 41004 | 3.1177          | 0.8403   | 0.6376   |
| 0.0352        | 304.0007 | 41138 | 2.9645          | 0.8504   | 0.6478   |
| 0.0263        | 305.0007 | 41272 | 3.1005          | 0.8454   | 0.6481   |
| 0.0277        | 306.0007 | 41406 | 3.1990          | 0.8431   | 0.6478   |
| 0.026         | 307.0007 | 41540 | 3.1607          | 0.8515   | 0.6448   |
| 0.0278        | 308.0007 | 41674 | 3.0239          | 0.8505   | 0.6483   |
| 0.0276        | 309.0007 | 41808 | 2.8455          | 0.8439   | 0.6409   |
| 0.0274        | 310.0007 | 41942 | 2.9537          | 0.8534   | 0.6494   |
| 0.0253        | 311.0007 | 42076 | 2.8886          | 0.8507   | 0.6510   |
| 0.0289        | 312.0007 | 42210 | 2.8655          | 0.8477   | 0.6453   |
| 0.0257        | 313.0007 | 42344 | 2.9944          | 0.8474   | 0.6456   |
| 0.0254        | 314.0007 | 42478 | 3.0366          | 0.8451   | 0.6442   |
| 0.024         | 315.0006 | 42612 | 3.0078          | 0.8498   | 0.6452   |
| 0.0249        | 316.0006 | 42746 | 2.8746          | 0.8519   | 0.6509   |
| 0.0235        | 317.0006 | 42880 | 2.9079          | 0.8473   | 0.6483   |
| 0.023         | 318.0006 | 43014 | 2.8602          | 0.8461   | 0.6457   |
| 0.0251        | 319.0006 | 43148 | 2.9523          | 0.8488   | 0.6409   |
| 0.0265        | 320.0006 | 43282 | 2.9855          | 0.8493   | 0.6469   |
| 0.0244        | 321.0006 | 43416 | 2.9887          | 0.8475   | 0.6499   |
| 0.0265        | 322.0006 | 43550 | 2.8213          | 0.8507   | 0.6473   |
| 0.0238        | 323.0006 | 43684 | 2.8575          | 0.8476   | 0.6437   |
| 0.025         | 324.0006 | 43818 | 2.9610          | 0.8501   | 0.6432   |
| 0.0231        | 325.0006 | 43952 | 2.8522          | 0.8491   | 0.6511   |
| 0.0219        | 326.0006 | 44086 | 2.9231          | 0.8463   | 0.6384   |
| 0.0209        | 327.0006 | 44220 | 2.8899          | 0.8465   | 0.6494   |
| 0.0211        | 328.0005 | 44354 | 2.6775          | 0.8508   | 0.6489   |
| 0.0218        | 329.0005 | 44488 | 2.7962          | 0.8480   | 0.6419   |
| 0.0254        | 330.0005 | 44622 | 2.8140          | 0.8487   | 0.6408   |
| 0.0238        | 331.0005 | 44756 | 2.7118          | 0.8527   | 0.6547   |
| 0.0262        | 332.0005 | 44890 | 2.8516          | 0.8497   | 0.6499   |
| 0.0224        | 333.0005 | 45024 | 2.9087          | 0.8534   | 0.6500   |
| 0.0215        | 334.0005 | 45158 | 2.7763          | 0.8532   | 0.6474   |
| 0.023         | 335.0005 | 45292 | 2.7799          | 0.8457   | 0.6505   |
| 0.022         | 336.0005 | 45426 | 3.0467          | 0.8501   | 0.6461   |
| 0.0257        | 337.0005 | 45560 | 2.8287          | 0.8499   | 0.6512   |
| 0.0224        | 338.0005 | 45694 | 2.8291          | 0.8531   | 0.6427   |
| 0.0235        | 339.0005 | 45828 | 2.9254          | 0.8494   | 0.6465   |
| 0.022         | 340.0005 | 45962 | 2.8953          | 0.8484   | 0.6466   |
| 0.0201        | 341.0005 | 46096 | 2.8090          | 0.8525   | 0.6487   |
| 0.0209        | 342.0004 | 46230 | 2.8339          | 0.8528   | 0.6536   |
| 0.0212        | 343.0004 | 46364 | 2.8510          | 0.8523   | 0.6578   |
| 0.0206        | 344.0004 | 46498 | 3.0095          | 0.8514   | 0.6505   |
| 0.0238        | 345.0004 | 46632 | 2.9282          | 0.8550   | 0.6504   |
| 0.0204        | 346.0004 | 46766 | 3.1101          | 0.8533   | 0.6533   |
| 0.0239        | 347.0004 | 46900 | 2.9568          | 0.8515   | 0.6511   |
| 0.0219        | 348.0004 | 47034 | 2.9648          | 0.8452   | 0.6439   |
| 0.0221        | 349.0004 | 47168 | 2.7161          | 0.8479   | 0.6500   |
| 0.0218        | 350.0004 | 47302 | 2.7864          | 0.8460   | 0.6547   |
| 0.021         | 351.0004 | 47436 | 2.6934          | 0.8536   | 0.6537   |
| 0.0193        | 352.0004 | 47570 | 2.8054          | 0.8518   | 0.6501   |
| 0.0208        | 353.0004 | 47704 | 2.6761          | 0.8492   | 0.6490   |
| 0.0194        | 354.0004 | 47838 | 2.6105          | 0.8532   | 0.6513   |
| 0.0179        | 355.0003 | 47972 | 2.6430          | 0.8513   | 0.6531   |
| 0.0189        | 356.0003 | 48106 | 2.8046          | 0.8519   | 0.6528   |
| 0.0191        | 357.0003 | 48240 | 2.7391          | 0.8504   | 0.6523   |
| 0.02          | 358.0003 | 48374 | 2.6332          | 0.8542   | 0.6545   |
| 0.019         | 359.0003 | 48508 | 2.7742          | 0.8542   | 0.6465   |
| 0.0213        | 360.0003 | 48642 | 2.6351          | 0.8531   | 0.6573   |
| 0.0195        | 361.0003 | 48776 | 2.6694          | 0.8533   | 0.6514   |
| 0.0206        | 362.0003 | 48910 | 2.5378          | 0.8562   | 0.6577   |
| 0.019         | 363.0003 | 49044 | 2.6648          | 0.8515   | 0.6495   |


### Framework versions

- Transformers 4.46.0
- Pytorch 2.3.1+cu121
- Datasets 2.20.0
- Tokenizers 0.20.1