File size: 26,630 Bytes
6271cd2
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
---
library_name: transformers
tags:
- generated_from_trainer
metrics:
- accuracy
model-index:
- name: ht-stmini-cls-v6_ftis_noPretrain-cssl-msm-bml
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# ht-stmini-cls-v6_ftis_noPretrain-cssl-msm-bml

This model is a fine-tuned version of [](https://huggingface.co/) on an unknown dataset.
It achieves the following results on the evaluation set:
- Loss: 16.6821
- Accuracy: 0.9045
- Macro F1: 0.7674

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 0.0001
- train_batch_size: 8
- eval_batch_size: 4
- seed: 42
- optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
- lr_scheduler_type: linear
- lr_scheduler_warmup_steps: 6733
- training_steps: 134674

### Training results

| Training Loss | Epoch    | Step  | Validation Loss | Accuracy | Macro F1 |
|:-------------:|:--------:|:-----:|:---------------:|:--------:|:--------:|
| 11715.2213    | 0.0013   | 174   | 10727.4766      | 0.0638   | 0.0283   |
| 8436.0012     | 1.0013   | 348   | 6992.4492       | 0.0706   | 0.0296   |
| 5873.0413     | 2.0013   | 522   | 3689.1555       | 0.0970   | 0.0358   |
| 2780.7009     | 3.0013   | 696   | 1901.4088       | 0.2850   | 0.0661   |
| 1096.5327     | 4.0013   | 870   | 828.9574        | 0.3923   | 0.0909   |
| 640.5421      | 5.0013   | 1044  | 513.9333        | 0.4514   | 0.1113   |
| 423.0914      | 6.0012   | 1218  | 396.2117        | 0.4752   | 0.1182   |
| 337.1574      | 7.0012   | 1392  | 330.5453        | 0.4958   | 0.1237   |
| 257.1514      | 8.0012   | 1566  | 264.8556        | 0.5144   | 0.1272   |
| 216.2928      | 9.0012   | 1740  | 216.6899        | 0.5206   | 0.1298   |
| 209.9206      | 10.0012  | 1914  | 184.6555        | 0.5321   | 0.1322   |
| 170.8291      | 11.0012  | 2088  | 159.6617        | 0.5371   | 0.1341   |
| 160.7261      | 12.0012  | 2262  | 145.2256        | 0.5420   | 0.1362   |
| 143.5558      | 13.0012  | 2436  | 130.5261        | 0.5432   | 0.1376   |
| 124.9779      | 14.0012  | 2610  | 121.6776        | 0.5549   | 0.1402   |
| 114.6333      | 15.0012  | 2784  | 114.0393        | 0.5567   | 0.1425   |
| 104.1651      | 16.0012  | 2958  | 105.7749        | 0.5675   | 0.1442   |
| 96.692        | 17.0012  | 3132  | 102.6569        | 0.5627   | 0.1446   |
| 89.7748       | 18.0012  | 3306  | 97.5948         | 0.5745   | 0.1468   |
| 89.4558       | 19.0012  | 3480  | 93.5582         | 0.5859   | 0.1512   |
| 80.687        | 20.0011  | 3654  | 88.2421         | 0.5775   | 0.1530   |
| 76.154        | 21.0011  | 3828  | 90.8190         | 0.5704   | 0.1501   |
| 73.2332       | 22.0011  | 4002  | 84.4550         | 0.5805   | 0.1565   |
| 71.9891       | 23.0011  | 4176  | 80.8633         | 0.5902   | 0.1596   |
| 70.2947       | 24.0011  | 4350  | 80.1923         | 0.5893   | 0.1611   |
| 67.5285       | 25.0011  | 4524  | 78.1419         | 0.5917   | 0.1608   |
| 66.9792       | 26.0011  | 4698  | 73.2892         | 0.6081   | 0.1703   |
| 65.348        | 27.0011  | 4872  | 70.4800         | 0.6047   | 0.1695   |
| 62.3904       | 28.0011  | 5046  | 76.0858         | 0.5940   | 0.1689   |
| 61.1992       | 29.0011  | 5220  | 67.9268         | 0.6100   | 0.1782   |
| 58.0391       | 30.0011  | 5394  | 64.8750         | 0.6191   | 0.1802   |
| 54.2658       | 31.0011  | 5568  | 64.0972         | 0.6239   | 0.1935   |
| 53.7429       | 32.0011  | 5742  | 61.6177         | 0.6336   | 0.1981   |
| 49.5539       | 33.0010  | 5916  | 63.4825         | 0.6351   | 0.1983   |
| 48.5641       | 34.0010  | 6090  | 59.5909         | 0.6448   | 0.2138   |
| 45.7779       | 35.0010  | 6264  | 58.3350         | 0.6224   | 0.2105   |
| 43.3097       | 36.0010  | 6438  | 55.5437         | 0.6561   | 0.2252   |
| 39.4661       | 37.0010  | 6612  | 54.4594         | 0.6593   | 0.2360   |
| 38.7875       | 38.0010  | 6786  | 51.2408         | 0.6655   | 0.2373   |
| 36.1766       | 39.0010  | 6960  | 50.7226         | 0.6749   | 0.2522   |
| 34.0581       | 40.0010  | 7134  | 51.9902         | 0.6780   | 0.2654   |
| 32.973        | 41.0010  | 7308  | 49.4649         | 0.6819   | 0.2732   |
| 31.9436       | 42.0010  | 7482  | 47.4678         | 0.6925   | 0.2859   |
| 29.808        | 43.0010  | 7656  | 47.4288         | 0.7010   | 0.2986   |
| 28.988        | 44.0010  | 7830  | 47.9734         | 0.7017   | 0.3069   |
| 28.5465       | 45.0010  | 8004  | 47.5173         | 0.7051   | 0.3021   |
| 25.2834       | 46.0010  | 8178  | 46.4361         | 0.7089   | 0.3154   |
| 26.4334       | 47.0009  | 8352  | 49.4728         | 0.7098   | 0.3195   |
| 23.5124       | 48.0009  | 8526  | 48.7914         | 0.7116   | 0.3339   |
| 23.1348       | 49.0009  | 8700  | 47.3581         | 0.7207   | 0.3396   |
| 21.6129       | 50.0009  | 8874  | 46.1953         | 0.7296   | 0.3557   |
| 22.9044       | 51.0009  | 9048  | 43.5262         | 0.7335   | 0.3583   |
| 21.2048       | 52.0009  | 9222  | 51.1645         | 0.6949   | 0.3454   |
| 18.3862       | 53.0009  | 9396  | 47.1605         | 0.7434   | 0.3746   |
| 18.8145       | 54.0009  | 9570  | 50.5842         | 0.7187   | 0.3316   |
| 17.9621       | 55.0009  | 9744  | 46.3175         | 0.7326   | 0.3595   |
| 15.6122       | 56.0009  | 9918  | 46.0008         | 0.7439   | 0.3860   |
| 14.9198       | 57.0009  | 10092 | 49.5679         | 0.7436   | 0.3994   |
| 15.1845       | 58.0009  | 10266 | 44.8107         | 0.7499   | 0.4040   |
| 14.2785       | 59.0009  | 10440 | 48.7127         | 0.7415   | 0.4033   |
| 14.1863       | 60.0008  | 10614 | 47.7495         | 0.7532   | 0.4077   |
| 14.0713       | 61.0008  | 10788 | 49.2214         | 0.7579   | 0.4159   |
| 14.7541       | 62.0008  | 10962 | 53.5513         | 0.7477   | 0.3994   |
| 13.3041       | 63.0008  | 11136 | 44.9118         | 0.7552   | 0.4194   |
| 11.6473       | 64.0008  | 11310 | 49.2335         | 0.7627   | 0.4315   |
| 11.2095       | 65.0008  | 11484 | 46.2891         | 0.7675   | 0.4325   |
| 10.2987       | 66.0008  | 11658 | 53.1796         | 0.7624   | 0.4306   |
| 11.346        | 67.0008  | 11832 | 51.8456         | 0.7657   | 0.4339   |
| 9.3548        | 68.0008  | 12006 | 50.8765         | 0.7678   | 0.4403   |
| 9.3037        | 69.0008  | 12180 | 55.0888         | 0.7714   | 0.4477   |
| 8.9857        | 70.0008  | 12354 | 50.0248         | 0.7628   | 0.4440   |
| 8.7682        | 71.0008  | 12528 | 50.6941         | 0.7770   | 0.4619   |
| 9.1196        | 72.0008  | 12702 | 46.8410         | 0.7684   | 0.4584   |
| 8.3427        | 73.0007  | 12876 | 50.8483         | 0.7652   | 0.4536   |
| 7.8778        | 74.0007  | 13050 | 46.3875         | 0.7793   | 0.4660   |
| 6.9879        | 75.0007  | 13224 | 45.0568         | 0.7834   | 0.4688   |
| 7.5269        | 76.0007  | 13398 | 46.9041         | 0.7858   | 0.4689   |
| 6.9116        | 77.0007  | 13572 | 48.1086         | 0.7663   | 0.4703   |
| 6.9254        | 78.0007  | 13746 | 47.4047         | 0.7879   | 0.4844   |
| 6.2481        | 79.0007  | 13920 | 44.9859         | 0.7813   | 0.4757   |
| 6.6851        | 80.0007  | 14094 | 38.6904         | 0.7850   | 0.4852   |
| 5.97          | 81.0007  | 14268 | 42.5499         | 0.7882   | 0.4812   |
| 6.1771        | 82.0007  | 14442 | 38.4021         | 0.7928   | 0.4936   |
| 5.1963        | 83.0007  | 14616 | 42.9896         | 0.7939   | 0.4888   |
| 7.9398        | 84.0007  | 14790 | 40.9555         | 0.7838   | 0.4915   |
| 5.3613        | 85.0007  | 14964 | 42.9515         | 0.7908   | 0.5045   |
| 6.7202        | 86.0007  | 15138 | 39.7180         | 0.7864   | 0.4951   |
| 4.6764        | 87.0006  | 15312 | 38.2246         | 0.7937   | 0.5101   |
| 4.2945        | 88.0006  | 15486 | 38.6347         | 0.7956   | 0.5087   |
| 4.1892        | 89.0006  | 15660 | 35.4375         | 0.7958   | 0.5055   |
| 4.1461        | 90.0006  | 15834 | 44.9172         | 0.7964   | 0.5127   |
| 4.2493        | 91.0006  | 16008 | 35.8057         | 0.7935   | 0.5037   |
| 4.7168        | 92.0006  | 16182 | 37.1874         | 0.8039   | 0.5202   |
| 3.7186        | 93.0006  | 16356 | 34.5887         | 0.7948   | 0.5243   |
| 3.9092        | 94.0006  | 16530 | 34.3659         | 0.8049   | 0.5224   |
| 3.4922        | 95.0006  | 16704 | 38.1849         | 0.7997   | 0.5176   |
| 3.293         | 96.0006  | 16878 | 33.7994         | 0.8127   | 0.5347   |
| 3.294         | 97.0006  | 17052 | 31.2770         | 0.8034   | 0.5267   |
| 2.8844        | 98.0006  | 17226 | 32.2301         | 0.8153   | 0.5347   |
| 2.8165        | 99.0006  | 17400 | 37.9324         | 0.7940   | 0.5233   |
| 2.6399        | 100.0005 | 17574 | 31.1739         | 0.8110   | 0.5344   |
| 2.686         | 101.0005 | 17748 | 35.2568         | 0.8088   | 0.5258   |
| 2.406         | 102.0005 | 17922 | 32.8968         | 0.8139   | 0.5458   |
| 2.799         | 103.0005 | 18096 | 25.1094         | 0.8134   | 0.5300   |
| 1.9403        | 104.0005 | 18270 | 24.3377         | 0.8120   | 0.5341   |
| 1.8998        | 105.0005 | 18444 | 26.6559         | 0.8116   | 0.5427   |
| 1.6745        | 106.0005 | 18618 | 21.0844         | 0.8184   | 0.5326   |
| 1.5847        | 107.0005 | 18792 | 30.5684         | 0.8138   | 0.5412   |
| 1.539         | 108.0005 | 18966 | 29.5075         | 0.8157   | 0.5621   |
| 1.5605        | 109.0005 | 19140 | 26.9982         | 0.8164   | 0.5514   |
| 1.4464        | 110.0005 | 19314 | 22.9506         | 0.8223   | 0.5683   |
| 1.4368        | 111.0005 | 19488 | 27.1973         | 0.8284   | 0.5693   |
| 1.3086        | 112.0005 | 19662 | 32.0884         | 0.8116   | 0.5541   |
| 1.3881        | 113.0005 | 19836 | 19.1791         | 0.8306   | 0.5773   |
| 1.316         | 114.0004 | 20010 | 27.2289         | 0.8293   | 0.5661   |
| 1.3519        | 115.0004 | 20184 | 25.0924         | 0.8373   | 0.5942   |
| 1.3086        | 116.0004 | 20358 | 25.9505         | 0.8431   | 0.5962   |
| 1.2558        | 117.0004 | 20532 | 20.9844         | 0.8427   | 0.6016   |
| 1.3284        | 118.0004 | 20706 | 22.0272         | 0.8413   | 0.5966   |
| 1.2293        | 119.0004 | 20880 | 25.0141         | 0.8435   | 0.6093   |
| 1.1877        | 120.0004 | 21054 | 20.0948         | 0.8421   | 0.5953   |
| 1.1295        | 121.0004 | 21228 | 19.8363         | 0.8276   | 0.5805   |
| 1.1163        | 122.0004 | 21402 | 21.4298         | 0.8490   | 0.6072   |
| 1.0742        | 123.0004 | 21576 | 20.9026         | 0.8480   | 0.6119   |
| 1.0389        | 124.0004 | 21750 | 20.7149         | 0.8366   | 0.6152   |
| 1.0495        | 125.0004 | 21924 | 25.3593         | 0.8510   | 0.6198   |
| 1.1515        | 126.0004 | 22098 | 17.9324         | 0.8443   | 0.6120   |
| 1.0378        | 127.0003 | 22272 | 22.3808         | 0.8535   | 0.6271   |
| 1.0459        | 128.0003 | 22446 | 19.1860         | 0.8384   | 0.6144   |
| 0.9204        | 129.0003 | 22620 | 20.5149         | 0.8564   | 0.6272   |
| 0.961         | 130.0003 | 22794 | 19.8676         | 0.8573   | 0.6349   |
| 0.9265        | 131.0003 | 22968 | 22.2702         | 0.8543   | 0.6308   |
| 1.156         | 132.0003 | 23142 | 25.0896         | 0.8532   | 0.6203   |
| 1.0723        | 133.0003 | 23316 | 12.4057         | 0.8546   | 0.6243   |
| 0.9053        | 134.0003 | 23490 | 16.2697         | 0.8589   | 0.6356   |
| 0.8414        | 135.0003 | 23664 | 18.2528         | 0.8594   | 0.6376   |
| 0.9563        | 136.0003 | 23838 | 18.9026         | 0.8606   | 0.6404   |
| 0.8713        | 137.0003 | 24012 | 20.1320         | 0.8659   | 0.6426   |
| 0.886         | 138.0003 | 24186 | 21.3480         | 0.8577   | 0.6253   |
| 0.8638        | 139.0003 | 24360 | 19.3888         | 0.8645   | 0.6429   |
| 0.841         | 140.0003 | 24534 | 19.2783         | 0.8650   | 0.6474   |
| 0.8303        | 141.0002 | 24708 | 19.9639         | 0.8597   | 0.6464   |
| 0.8369        | 142.0002 | 24882 | 11.9309         | 0.8621   | 0.6514   |
| 0.715         | 143.0002 | 25056 | 13.8198         | 0.8681   | 0.6544   |
| 0.849         | 144.0002 | 25230 | 10.8690         | 0.8619   | 0.6375   |
| 0.8585        | 145.0002 | 25404 | 10.9302         | 0.8658   | 0.6518   |
| 0.7652        | 146.0002 | 25578 | 15.6227         | 0.8729   | 0.6648   |
| 0.7047        | 147.0002 | 25752 | 17.5963         | 0.8691   | 0.6607   |
| 0.7735        | 148.0002 | 25926 | 15.9798         | 0.8699   | 0.6584   |
| 0.7502        | 149.0002 | 26100 | 16.9661         | 0.8721   | 0.6640   |
| 0.6434        | 150.0002 | 26274 | 18.8849         | 0.8607   | 0.6547   |
| 0.7066        | 151.0002 | 26448 | 17.9607         | 0.8724   | 0.6668   |
| 0.6763        | 152.0002 | 26622 | 21.1410         | 0.8661   | 0.6678   |
| 0.6306        | 153.0002 | 26796 | 22.4174         | 0.8637   | 0.6507   |
| 0.6913        | 154.0001 | 26970 | 19.5015         | 0.8711   | 0.6677   |
| 0.6406        | 155.0001 | 27144 | 19.9176         | 0.8712   | 0.6669   |
| 0.7159        | 156.0001 | 27318 | 13.8663         | 0.8693   | 0.6673   |
| 0.7575        | 157.0001 | 27492 | 16.8359         | 0.8713   | 0.6741   |
| 0.6609        | 158.0001 | 27666 | 15.3045         | 0.8712   | 0.6728   |
| 0.6315        | 159.0001 | 27840 | 17.4548         | 0.8665   | 0.6735   |
| 0.6101        | 160.0001 | 28014 | 20.8768         | 0.8704   | 0.6730   |
| 0.64          | 161.0001 | 28188 | 18.5729         | 0.8765   | 0.6720   |
| 0.623         | 162.0001 | 28362 | 20.3598         | 0.8792   | 0.6778   |
| 0.5812        | 163.0001 | 28536 | 13.9977         | 0.8784   | 0.6792   |
| 0.5705        | 164.0001 | 28710 | 16.8151         | 0.8766   | 0.6763   |
| 0.584         | 165.0001 | 28884 | 18.1551         | 0.8797   | 0.6880   |
| 0.5394        | 166.0001 | 29058 | 17.7883         | 0.8784   | 0.6792   |
| 0.5432        | 167.0001 | 29232 | 19.1870         | 0.8770   | 0.6836   |
| 0.6009        | 168.0000 | 29406 | 16.1470         | 0.8818   | 0.6899   |
| 0.5492        | 169.0000 | 29580 | 16.3520         | 0.8801   | 0.6826   |
| 0.5594        | 170.0000 | 29754 | 15.6605         | 0.8777   | 0.6853   |
| 0.5397        | 171.0000 | 29928 | 17.4010         | 0.8783   | 0.6873   |
| 0.4919        | 172.0000 | 30102 | 18.0559         | 0.8848   | 0.6951   |
| 0.53          | 173.0000 | 30276 | 14.1754         | 0.8822   | 0.6955   |
| 0.5522        | 173.0013 | 30450 | 14.0451         | 0.8741   | 0.6914   |
| 0.5484        | 174.0013 | 30624 | 16.6871         | 0.8801   | 0.6916   |
| 0.5278        | 175.0013 | 30798 | 15.2314         | 0.8824   | 0.6921   |
| 0.4913        | 176.0013 | 30972 | 16.4353         | 0.8809   | 0.6945   |
| 0.52          | 177.0013 | 31146 | 18.0517         | 0.8868   | 0.7032   |
| 0.5637        | 178.0013 | 31320 | 16.3400         | 0.8423   | 0.6632   |
| 0.5497        | 179.0013 | 31494 | 14.6085         | 0.8776   | 0.6914   |
| 0.4954        | 180.0012 | 31668 | 14.8209         | 0.8848   | 0.7004   |
| 0.48          | 181.0012 | 31842 | 17.6260         | 0.8836   | 0.6990   |
| 0.6265        | 182.0012 | 32016 | 10.3516         | 0.8797   | 0.6926   |
| 0.4802        | 183.0012 | 32190 | 12.9974         | 0.8857   | 0.6996   |
| 0.4944        | 184.0012 | 32364 | 13.7040         | 0.8835   | 0.7034   |
| 0.5148        | 185.0012 | 32538 | 15.6512         | 0.8823   | 0.6999   |
| 0.4609        | 186.0012 | 32712 | 16.7489         | 0.8856   | 0.6994   |
| 0.4298        | 187.0012 | 32886 | 13.6762         | 0.8844   | 0.7002   |
| 0.4083        | 188.0012 | 33060 | 17.2014         | 0.8841   | 0.7030   |
| 0.5683        | 189.0012 | 33234 | 14.0504         | 0.8500   | 0.6427   |
| 0.4913        | 190.0012 | 33408 | 13.4722         | 0.8826   | 0.6992   |
| 0.4486        | 191.0012 | 33582 | 14.0649         | 0.8867   | 0.7038   |
| 0.4617        | 192.0012 | 33756 | 14.5238         | 0.8866   | 0.7051   |
| 0.4362        | 193.0012 | 33930 | 15.3280         | 0.8863   | 0.7062   |
| 0.4396        | 194.0011 | 34104 | 14.3054         | 0.8856   | 0.7045   |
| 0.3991        | 195.0011 | 34278 | 16.1425         | 0.8871   | 0.7053   |
| 0.3911        | 196.0011 | 34452 | 16.3227         | 0.8872   | 0.7150   |
| 0.4021        | 197.0011 | 34626 | 15.9223         | 0.8907   | 0.7169   |
| 0.4325        | 198.0011 | 34800 | 16.4887         | 0.8871   | 0.7072   |
| 0.4289        | 199.0011 | 34974 | 13.0254         | 0.8877   | 0.7120   |
| 0.4118        | 200.0011 | 35148 | 14.3179         | 0.8889   | 0.7133   |
| 0.3828        | 201.0011 | 35322 | 15.9050         | 0.8898   | 0.7142   |
| 0.399         | 202.0011 | 35496 | 15.5794         | 0.8930   | 0.7183   |
| 0.3962        | 203.0011 | 35670 | 23.9086         | 0.8873   | 0.7071   |
| 0.4236        | 204.0011 | 35844 | 14.5871         | 0.8892   | 0.7151   |
| 0.4175        | 205.0011 | 36018 | 13.0064         | 0.8888   | 0.7143   |
| 0.4509        | 206.0011 | 36192 | 14.4157         | 0.8907   | 0.7151   |
| 0.3698        | 207.0010 | 36366 | 16.9400         | 0.8911   | 0.7209   |
| 0.3959        | 208.0010 | 36540 | 11.6492         | 0.8919   | 0.7223   |
| 0.3722        | 209.0010 | 36714 | 10.6274         | 0.8906   | 0.7213   |
| 0.3643        | 210.0010 | 36888 | 13.9021         | 0.8901   | 0.7212   |
| 0.3607        | 211.0010 | 37062 | 16.8761         | 0.8906   | 0.7100   |
| 0.3781        | 212.0010 | 37236 | 14.9723         | 0.8920   | 0.7246   |
| 0.3774        | 213.0010 | 37410 | 16.4877         | 0.8887   | 0.7216   |
| 0.4089        | 214.0010 | 37584 | 14.8110         | 0.8910   | 0.7227   |
| 0.3354        | 215.0010 | 37758 | 15.7290         | 0.8931   | 0.7241   |
| 0.3453        | 216.0010 | 37932 | 17.8587         | 0.8930   | 0.7262   |
| 0.3855        | 217.0010 | 38106 | 16.6364         | 0.8923   | 0.7205   |
| 0.3547        | 218.0010 | 38280 | 15.0288         | 0.8902   | 0.7262   |
| 0.3944        | 219.0010 | 38454 | 15.1244         | 0.8928   | 0.7267   |
| 0.3322        | 220.0010 | 38628 | 15.5708         | 0.8974   | 0.7308   |
| 0.5656        | 221.0009 | 38802 | 15.3676         | 0.8853   | 0.7131   |
| 0.3659        | 222.0009 | 38976 | 7.9423          | 0.8845   | 0.7166   |
| 0.3521        | 223.0009 | 39150 | 13.7582         | 0.8929   | 0.7277   |
| 0.3583        | 224.0009 | 39324 | 14.8325         | 0.8933   | 0.7351   |
| 0.3265        | 225.0009 | 39498 | 15.1472         | 0.8937   | 0.7340   |
| 0.3049        | 226.0009 | 39672 | 14.5932         | 0.8885   | 0.7246   |
| 0.336         | 227.0009 | 39846 | 14.2317         | 0.8925   | 0.7312   |
| 0.3057        | 228.0009 | 40020 | 16.1414         | 0.8932   | 0.7360   |
| 0.3329        | 229.0009 | 40194 | 15.2193         | 0.8920   | 0.7296   |
| 0.2967        | 230.0009 | 40368 | 16.3685         | 0.8949   | 0.7350   |
| 0.3154        | 231.0009 | 40542 | 15.8833         | 0.8973   | 0.7380   |
| 0.3414        | 232.0009 | 40716 | 11.7715         | 0.8954   | 0.7344   |
| 0.3231        | 233.0009 | 40890 | 13.7687         | 0.8964   | 0.7366   |
| 0.3277        | 234.0008 | 41064 | 16.5868         | 0.8933   | 0.7321   |
| 0.3384        | 235.0008 | 41238 | 14.9357         | 0.8951   | 0.7408   |
| 0.3358        | 236.0008 | 41412 | 16.2438         | 0.8969   | 0.7389   |
| 0.2861        | 237.0008 | 41586 | 13.7728         | 0.8858   | 0.7211   |
| 0.3149        | 238.0008 | 41760 | 16.2031         | 0.8964   | 0.7378   |
| 0.3268        | 239.0008 | 41934 | 13.5356         | 0.8984   | 0.7366   |
| 0.3158        | 240.0008 | 42108 | 16.0668         | 0.8983   | 0.7363   |
| 0.288         | 241.0008 | 42282 | 16.6506         | 0.8969   | 0.7388   |
| 0.2693        | 242.0008 | 42456 | 15.0677         | 0.8951   | 0.7397   |
| 0.2793        | 243.0008 | 42630 | 16.6893         | 0.8964   | 0.7415   |
| 0.2718        | 244.0008 | 42804 | 17.5266         | 0.8981   | 0.7434   |
| 0.2792        | 245.0008 | 42978 | 16.0863         | 0.8937   | 0.7354   |
| 0.3232        | 246.0008 | 43152 | 18.1412         | 0.8959   | 0.7379   |
| 0.2769        | 247.0007 | 43326 | 18.2384         | 0.8975   | 0.7482   |
| 0.2967        | 248.0007 | 43500 | 15.9407         | 0.8972   | 0.7458   |
| 0.3054        | 249.0007 | 43674 | 16.6762         | 0.8957   | 0.7415   |
| 0.2838        | 250.0007 | 43848 | 16.8079         | 0.8988   | 0.7406   |
| 0.2707        | 251.0007 | 44022 | 16.9714         | 0.8952   | 0.7420   |
| 0.4811        | 252.0007 | 44196 | 9.5724          | 0.8906   | 0.7180   |
| 0.3373        | 253.0007 | 44370 | 11.0438         | 0.8960   | 0.7408   |
| 0.2654        | 254.0007 | 44544 | 14.4336         | 0.8971   | 0.7454   |
| 0.3087        | 255.0007 | 44718 | 14.2193         | 0.8973   | 0.7442   |
| 0.257         | 256.0007 | 44892 | 15.4050         | 0.8977   | 0.7428   |
| 0.2951        | 257.0007 | 45066 | 16.0725         | 0.8952   | 0.7405   |
| 0.25          | 258.0007 | 45240 | 17.0912         | 0.9012   | 0.7467   |
| 0.2637        | 259.0007 | 45414 | 15.3124         | 0.8975   | 0.7474   |
| 0.2375        | 260.0007 | 45588 | 14.8288         | 0.8974   | 0.7481   |
| 0.2269        | 261.0006 | 45762 | 16.0601         | 0.8986   | 0.7459   |
| 0.2742        | 262.0006 | 45936 | 14.0432         | 0.8977   | 0.7442   |
| 0.271         | 263.0006 | 46110 | 16.4956         | 0.8985   | 0.7466   |
| 0.3463        | 264.0006 | 46284 | 15.3674         | 0.8992   | 0.7449   |
| 0.2848        | 265.0006 | 46458 | 14.0978         | 0.9003   | 0.7483   |
| 0.2487        | 266.0006 | 46632 | 14.9997         | 0.8964   | 0.7437   |
| 0.2619        | 267.0006 | 46806 | 13.5976         | 0.8982   | 0.7492   |
| 0.2388        | 268.0006 | 46980 | 14.3842         | 0.8983   | 0.7478   |
| 0.2354        | 269.0006 | 47154 | 13.7162         | 0.8976   | 0.7481   |
| 0.2466        | 270.0006 | 47328 | 12.8044         | 0.9018   | 0.7484   |
| 0.2399        | 271.0006 | 47502 | 13.4347         | 0.8993   | 0.7506   |
| 0.4447        | 272.0006 | 47676 | 9.7105          | 0.9009   | 0.7438   |
| 0.261         | 273.0006 | 47850 | 12.8051         | 0.8953   | 0.7429   |
| 0.2415        | 274.0005 | 48024 | 14.9494         | 0.9013   | 0.7553   |
| 0.243         | 275.0005 | 48198 | 12.9017         | 0.9011   | 0.7557   |
| 0.2873        | 276.0005 | 48372 | 12.4695         | 0.9018   | 0.7545   |
| 0.3073        | 277.0005 | 48546 | 12.9455         | 0.9025   | 0.7533   |
| 0.2429        | 278.0005 | 48720 | 12.1919         | 0.9012   | 0.7548   |
| 0.2311        | 279.0005 | 48894 | 15.6412         | 0.9015   | 0.7576   |
| 0.3222        | 280.0005 | 49068 | 13.7687         | 0.8931   | 0.7480   |
| 0.2178        | 281.0005 | 49242 | 16.8131         | 0.8974   | 0.7473   |
| 0.2413        | 282.0005 | 49416 | 13.5668         | 0.9030   | 0.7568   |
| 0.2337        | 283.0005 | 49590 | 15.5167         | 0.9008   | 0.7509   |
| 0.2513        | 284.0005 | 49764 | 16.4551         | 0.8979   | 0.7481   |
| 0.2399        | 285.0005 | 49938 | 13.4715         | 0.9032   | 0.7578   |
| 0.2308        | 286.0005 | 50112 | 14.5640         | 0.9040   | 0.7604   |
| 0.3765        | 287.0005 | 50286 | 13.2947         | 0.8803   | 0.7446   |
| 0.2562        | 288.0004 | 50460 | 16.2386         | 0.8987   | 0.7529   |
| 0.2337        | 289.0004 | 50634 | 16.6809         | 0.9031   | 0.7574   |
| 0.2278        | 290.0004 | 50808 | 14.7238         | 0.8995   | 0.7506   |
| 0.2222        | 291.0004 | 50982 | 17.9847         | 0.8992   | 0.7488   |
| 0.2202        | 292.0004 | 51156 | 12.6368         | 0.9008   | 0.7505   |
| 0.2145        | 293.0004 | 51330 | 13.8875         | 0.9025   | 0.7545   |
| 0.2409        | 294.0004 | 51504 | 14.1272         | 0.9022   | 0.7581   |
| 0.2281        | 295.0004 | 51678 | 14.1585         | 0.9023   | 0.7568   |
| 0.2312        | 296.0004 | 51852 | 14.0201         | 0.9006   | 0.7487   |
| 0.2131        | 297.0004 | 52026 | 15.6053         | 0.9005   | 0.7523   |
| 0.2297        | 298.0004 | 52200 | 13.9298         | 0.9053   | 0.7579   |
| 0.2197        | 299.0004 | 52374 | 15.9253         | 0.9036   | 0.7602   |
| 0.2383        | 300.0004 | 52548 | 12.9275         | 0.9027   | 0.7574   |
| 0.2153        | 301.0003 | 52722 | 16.5673         | 0.9047   | 0.7617   |
| 0.1957        | 302.0003 | 52896 | 19.4735         | 0.9031   | 0.7586   |
| 0.1985        | 303.0003 | 53070 | 15.1224         | 0.9049   | 0.7613   |
| 0.1922        | 304.0003 | 53244 | 17.6586         | 0.9027   | 0.7601   |
| 0.2092        | 305.0003 | 53418 | 16.8100         | 0.9045   | 0.7674   |
| 0.2035        | 306.0003 | 53592 | 17.3255         | 0.9023   | 0.7621   |
| 0.247         | 307.0003 | 53766 | 14.9393         | 0.9015   | 0.7579   |
| 0.2209        | 308.0003 | 53940 | 17.7670         | 0.9018   | 0.7616   |
| 0.21          | 309.0003 | 54114 | 17.3934         | 0.9042   | 0.7635   |
| 0.2049        | 310.0003 | 54288 | 19.5490         | 0.9007   | 0.7545   |
| 0.2023        | 311.0003 | 54462 | 16.2449         | 0.9038   | 0.7566   |
| 0.3726        | 312.0003 | 54636 | 10.4166         | 0.8765   | 0.7226   |
| 0.2432        | 313.0003 | 54810 | 11.6401         | 0.9034   | 0.7608   |
| 0.2181        | 314.0003 | 54984 | 14.3938         | 0.9044   | 0.7654   |
| 0.2029        | 315.0002 | 55158 | 15.7325         | 0.9019   | 0.7607   |
| 0.2003        | 316.0002 | 55332 | 17.3243         | 0.9023   | 0.7618   |
| 0.1899        | 317.0002 | 55506 | 14.7359         | 0.9040   | 0.7672   |
| 0.1948        | 318.0002 | 55680 | 15.1991         | 0.9049   | 0.7664   |
| 0.2076        | 319.0002 | 55854 | 15.9182         | 0.8995   | 0.7574   |
| 0.2239        | 320.0002 | 56028 | 12.1547         | 0.9031   | 0.7585   |
| 0.1866        | 321.0002 | 56202 | 15.7659         | 0.9037   | 0.7624   |
| 0.1721        | 322.0002 | 56376 | 16.8787         | 0.9054   | 0.7635   |
| 0.1717        | 323.0002 | 56550 | 15.8258         | 0.9025   | 0.7619   |
| 0.1908        | 324.0002 | 56724 | 18.5532         | 0.9037   | 0.7618   |
| 0.1968        | 325.0002 | 56898 | 18.5373         | 0.9060   | 0.7662   |


### Framework versions

- Transformers 4.46.0
- Pytorch 2.3.1+cu121
- Datasets 2.20.0
- Tokenizers 0.20.1