File size: 28,814 Bytes
fdd75d8
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
7c41b6a
 
 
fdd75d8
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
7c41b6a
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
fdd75d8
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
---
library_name: transformers
tags:
- generated_from_trainer
metrics:
- accuracy
model-index:
- name: ht-stmini-cls-v6_ftis_noPretrain-cssl-npsNonennsNone-masked
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# ht-stmini-cls-v6_ftis_noPretrain-cssl-npsNonennsNone-masked

This model is a fine-tuned version of [](https://huggingface.co/) on an unknown dataset.
It achieves the following results on the evaluation set:
- Loss: 40.4007
- Accuracy: 0.9252
- Macro F1: 0.8229

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 0.0001
- train_batch_size: 8
- eval_batch_size: 4
- seed: 42
- optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
- lr_scheduler_type: linear
- lr_scheduler_warmup_steps: 6733
- training_steps: 134674

### Training results

| Training Loss | Epoch    | Step  | Validation Loss | Accuracy | Macro F1 |
|:-------------:|:--------:|:-----:|:---------------:|:--------:|:--------:|
| 1058.768      | 0.0013   | 174   | 903.1061        | 0.0521   | 0.0276   |
| 302.8637      | 1.0013   | 348   | 219.2956        | 0.0904   | 0.0381   |
| 95.7511       | 2.0013   | 522   | 326.8114        | 0.2266   | 0.0658   |
| 78.4313       | 3.0013   | 696   | 354.0350        | 0.3470   | 0.0917   |
| 69.5464       | 4.0013   | 870   | 385.0882        | 0.4182   | 0.1065   |
| 65.2821       | 5.0013   | 1044  | 409.7349        | 0.4612   | 0.1149   |
| 60.9194       | 6.0012   | 1218  | 362.8458        | 0.4804   | 0.1192   |
| 58.2193       | 7.0012   | 1392  | 398.8410        | 0.5011   | 0.1249   |
| 54.4017       | 8.0012   | 1566  | 399.3748        | 0.5141   | 0.1272   |
| 52.1109       | 9.0012   | 1740  | 392.4926        | 0.5297   | 0.1302   |
| 48.5245       | 10.0012  | 1914  | 361.4272        | 0.5345   | 0.1322   |
| 46.4394       | 11.0012  | 2088  | 284.8040        | 0.5392   | 0.1331   |
| 44.9365       | 12.0012  | 2262  | 251.8859        | 0.5479   | 0.1360   |
| 42.4856       | 13.0012  | 2436  | 224.2316        | 0.5526   | 0.1381   |
| 40.3551       | 14.0012  | 2610  | 182.5441        | 0.5662   | 0.1419   |
| 38.3803       | 15.0012  | 2784  | 168.5659        | 0.5665   | 0.1428   |
| 36.585        | 16.0012  | 2958  | 158.2095        | 0.5777   | 0.1460   |
| 34.9725       | 17.0012  | 3132  | 149.1070        | 0.5800   | 0.1490   |
| 33.1353       | 18.0012  | 3306  | 128.2565        | 0.5792   | 0.1509   |
| 31.8966       | 19.0012  | 3480  | 121.3380        | 0.6056   | 0.1571   |
| 30.0095       | 20.0011  | 3654  | 106.0147        | 0.5882   | 0.1600   |
| 28.3575       | 21.0011  | 3828  | 107.7094        | 0.6138   | 0.1686   |
| 26.1836       | 22.0011  | 4002  | 98.3186         | 0.6123   | 0.1715   |
| 25.1814       | 23.0011  | 4176  | 90.8617         | 0.6216   | 0.1794   |
| 23.1748       | 24.0011  | 4350  | 85.9976         | 0.6236   | 0.1883   |
| 21.1803       | 25.0011  | 4524  | 80.6459         | 0.6534   | 0.1921   |
| 20.2536       | 26.0011  | 4698  | 77.4688         | 0.6687   | 0.2123   |
| 18.7913       | 27.0011  | 4872  | 71.6915         | 0.6731   | 0.2142   |
| 17.3466       | 28.0011  | 5046  | 71.8286         | 0.6786   | 0.2241   |
| 16.4451       | 29.0011  | 5220  | 70.2575         | 0.6960   | 0.2510   |
| 15.5112       | 30.0011  | 5394  | 70.7488         | 0.7041   | 0.2575   |
| 14.1935       | 31.0011  | 5568  | 64.6462         | 0.7074   | 0.2713   |
| 14.2574       | 32.0011  | 5742  | 66.1510         | 0.7120   | 0.2860   |
| 12.4453       | 33.0010  | 5916  | 61.1035         | 0.7253   | 0.2964   |
| 11.8568       | 34.0010  | 6090  | 61.0196         | 0.7168   | 0.3049   |
| 10.731        | 35.0010  | 6264  | 70.6306         | 0.7328   | 0.3331   |
| 10.1356       | 36.0010  | 6438  | 58.4792         | 0.7437   | 0.3463   |
| 9.318         | 37.0010  | 6612  | 57.9372         | 0.7431   | 0.3532   |
| 9.0227        | 38.0010  | 6786  | 66.2533         | 0.7525   | 0.3696   |
| 8.2078        | 39.0010  | 6960  | 64.2905         | 0.7643   | 0.3945   |
| 7.5571        | 40.0010  | 7134  | 60.4497         | 0.7596   | 0.3979   |
| 7.1758        | 41.0010  | 7308  | 67.4727         | 0.7711   | 0.4100   |
| 6.7702        | 42.0010  | 7482  | 68.5978         | 0.7771   | 0.4229   |
| 6.1002        | 43.0010  | 7656  | 74.4439         | 0.7798   | 0.4403   |
| 5.7728        | 44.0010  | 7830  | 69.5670         | 0.7801   | 0.4485   |
| 5.1659        | 45.0010  | 8004  | 69.5194         | 0.7896   | 0.4519   |
| 4.7854        | 46.0010  | 8178  | 66.7023         | 0.7894   | 0.4568   |
| 4.593         | 47.0009  | 8352  | 82.9398         | 0.7854   | 0.4718   |
| 4.2214        | 48.0009  | 8526  | 78.9803         | 0.7963   | 0.4714   |
| 3.7953        | 49.0009  | 8700  | 80.9261         | 0.7988   | 0.4844   |
| 3.6161        | 50.0009  | 8874  | 75.4678         | 0.8023   | 0.4977   |
| 3.8841        | 51.0009  | 9048  | 83.3644         | 0.7969   | 0.4857   |
| 3.2126        | 52.0009  | 9222  | 76.7733         | 0.8055   | 0.5051   |
| 2.8338        | 53.0009  | 9396  | 80.0934         | 0.8042   | 0.5124   |
| 2.7141        | 54.0009  | 9570  | 79.4974         | 0.8131   | 0.5140   |
| 2.6783        | 55.0009  | 9744  | 80.7617         | 0.8084   | 0.5162   |
| 2.1781        | 56.0009  | 9918  | 72.0322         | 0.8170   | 0.5268   |
| 2.0639        | 57.0009  | 10092 | 79.9103         | 0.8216   | 0.5425   |
| 2.0582        | 58.0009  | 10266 | 81.0863         | 0.8154   | 0.5408   |
| 1.8545        | 59.0009  | 10440 | 78.7189         | 0.8274   | 0.5510   |
| 1.7443        | 60.0008  | 10614 | 79.8855         | 0.8287   | 0.5587   |
| 1.6105        | 61.0008  | 10788 | 84.5002         | 0.8319   | 0.5588   |
| 1.4347        | 62.0008  | 10962 | 89.3110         | 0.8355   | 0.5638   |
| 1.2463        | 63.0008  | 11136 | 84.1584         | 0.8399   | 0.5737   |
| 1.0172        | 64.0008  | 11310 | 65.4737         | 0.8414   | 0.5740   |
| 0.8612        | 65.0008  | 11484 | 54.9639         | 0.8329   | 0.5526   |
| 0.6844        | 66.0008  | 11658 | 55.0387         | 0.8412   | 0.5739   |
| 0.6818        | 67.0008  | 11832 | 53.5930         | 0.8492   | 0.5785   |
| 0.5892        | 68.0008  | 12006 | 70.1320         | 0.8526   | 0.5934   |
| 0.5648        | 69.0008  | 12180 | 69.6997         | 0.8514   | 0.5967   |
| 0.5655        | 70.0008  | 12354 | 73.2505         | 0.8549   | 0.6024   |
| 0.4963        | 71.0008  | 12528 | 67.4335         | 0.8498   | 0.6035   |
| 0.5229        | 72.0008  | 12702 | 72.7230         | 0.8571   | 0.6080   |
| 0.4048        | 73.0007  | 12876 | 66.1359         | 0.8605   | 0.6222   |
| 0.4078        | 74.0007  | 13050 | 65.4070         | 0.8641   | 0.6226   |
| 0.3733        | 75.0007  | 13224 | 60.0746         | 0.8629   | 0.6241   |
| 0.3758        | 76.0007  | 13398 | 66.0019         | 0.8609   | 0.6251   |
| 0.3442        | 77.0007  | 13572 | 63.3175         | 0.8717   | 0.6400   |
| 0.3059        | 78.0007  | 13746 | 67.6954         | 0.8660   | 0.6372   |
| 0.2867        | 79.0007  | 13920 | 59.4604         | 0.8768   | 0.6451   |
| 0.3113        | 80.0007  | 14094 | 59.2486         | 0.8715   | 0.6401   |
| 0.2823        | 81.0007  | 14268 | 56.5899         | 0.8769   | 0.6551   |
| 0.2496        | 82.0007  | 14442 | 56.0448         | 0.8802   | 0.6603   |
| 0.2461        | 83.0007  | 14616 | 52.7884         | 0.8776   | 0.6571   |
| 0.2295        | 84.0007  | 14790 | 54.9771         | 0.8735   | 0.6628   |
| 0.2256        | 85.0007  | 14964 | 53.1925         | 0.8772   | 0.6719   |
| 0.2191        | 86.0007  | 15138 | 47.3722         | 0.8849   | 0.6776   |
| 0.216         | 87.0006  | 15312 | 46.2669         | 0.8824   | 0.6720   |
| 0.1963        | 88.0006  | 15486 | 45.9061         | 0.8850   | 0.6685   |
| 0.2035        | 89.0006  | 15660 | 44.1860         | 0.8825   | 0.6820   |
| 0.1916        | 90.0006  | 15834 | 41.2766         | 0.8860   | 0.6892   |
| 0.1973        | 91.0006  | 16008 | 41.9826         | 0.8882   | 0.6913   |
| 0.1908        | 92.0006  | 16182 | 45.0961         | 0.8855   | 0.6872   |
| 0.1717        | 93.0006  | 16356 | 41.9536         | 0.8869   | 0.6939   |
| 0.1733        | 94.0006  | 16530 | 40.4401         | 0.8889   | 0.6949   |
| 0.1547        | 95.0006  | 16704 | 35.2369         | 0.8901   | 0.6919   |
| 0.1592        | 96.0006  | 16878 | 37.3337         | 0.8920   | 0.6959   |
| 0.1646        | 97.0006  | 17052 | 40.8861         | 0.8884   | 0.7003   |
| 0.1448        | 98.0006  | 17226 | 37.8190         | 0.8932   | 0.7086   |
| 0.1353        | 99.0006  | 17400 | 34.3224         | 0.8900   | 0.7018   |
| 0.1427        | 100.0005 | 17574 | 33.3914         | 0.8935   | 0.7134   |
| 0.1553        | 101.0005 | 17748 | 34.0533         | 0.8940   | 0.7088   |
| 0.1412        | 102.0005 | 17922 | 33.9799         | 0.8960   | 0.7154   |
| 0.1278        | 103.0005 | 18096 | 34.3961         | 0.8971   | 0.7135   |
| 0.1246        | 104.0005 | 18270 | 34.4814         | 0.8921   | 0.7058   |
| 0.1211        | 105.0005 | 18444 | 31.2263         | 0.8938   | 0.7108   |
| 0.1156        | 106.0005 | 18618 | 31.4636         | 0.8958   | 0.7233   |
| 0.1237        | 107.0005 | 18792 | 36.6337         | 0.8957   | 0.7219   |
| 0.119         | 108.0005 | 18966 | 33.4733         | 0.8969   | 0.7197   |
| 0.1144        | 109.0005 | 19140 | 28.5187         | 0.8960   | 0.7254   |
| 0.1001        | 110.0005 | 19314 | 29.9183         | 0.8947   | 0.7188   |
| 0.1091        | 111.0005 | 19488 | 30.0166         | 0.8969   | 0.7146   |
| 0.1002        | 112.0005 | 19662 | 32.1305         | 0.8972   | 0.7213   |
| 0.0963        | 113.0005 | 19836 | 27.5234         | 0.8966   | 0.7276   |
| 0.0963        | 114.0004 | 20010 | 32.0683         | 0.8966   | 0.7253   |
| 0.1159        | 115.0004 | 20184 | 27.8024         | 0.8993   | 0.7284   |
| 0.0992        | 116.0004 | 20358 | 29.4216         | 0.9001   | 0.7317   |
| 0.1002        | 117.0004 | 20532 | 28.2778         | 0.9008   | 0.7396   |
| 0.1055        | 118.0004 | 20706 | 30.6221         | 0.9044   | 0.7352   |
| 0.0889        | 119.0004 | 20880 | 27.7168         | 0.9044   | 0.7390   |
| 0.093         | 120.0004 | 21054 | 26.6910         | 0.9010   | 0.7407   |
| 0.0741        | 121.0004 | 21228 | 26.9066         | 0.9025   | 0.7405   |
| 0.082         | 122.0004 | 21402 | 30.9631         | 0.9003   | 0.7372   |
| 0.0834        | 123.0004 | 21576 | 27.1792         | 0.9046   | 0.7402   |
| 0.0847        | 124.0004 | 21750 | 26.8367         | 0.9018   | 0.7412   |
| 0.0749        | 125.0004 | 21924 | 27.8746         | 0.9028   | 0.7441   |
| 0.0791        | 126.0004 | 22098 | 27.0783         | 0.8990   | 0.7356   |
| 0.0743        | 127.0003 | 22272 | 25.5253         | 0.9040   | 0.7444   |
| 0.0778        | 128.0003 | 22446 | 28.0174         | 0.9042   | 0.7470   |
| 0.0741        | 129.0003 | 22620 | 27.6009         | 0.9031   | 0.7493   |
| 0.0787        | 130.0003 | 22794 | 28.4356         | 0.9067   | 0.7495   |
| 0.0701        | 131.0003 | 22968 | 24.3254         | 0.9026   | 0.7463   |
| 0.0663        | 132.0003 | 23142 | 24.1960         | 0.9033   | 0.7435   |
| 0.0719        | 133.0003 | 23316 | 28.6226         | 0.9027   | 0.7466   |
| 0.0674        | 134.0003 | 23490 | 29.0067         | 0.9004   | 0.7441   |
| 0.0606        | 135.0003 | 23664 | 26.3526         | 0.9063   | 0.7487   |
| 0.0667        | 136.0003 | 23838 | 28.2848         | 0.9040   | 0.7541   |
| 0.0685        | 137.0003 | 24012 | 27.0463         | 0.9022   | 0.7468   |
| 0.0762        | 138.0003 | 24186 | 27.0543         | 0.9047   | 0.7499   |
| 0.0653        | 139.0003 | 24360 | 27.0834         | 0.9019   | 0.7526   |
| 0.0692        | 140.0003 | 24534 | 25.8883         | 0.9069   | 0.7597   |
| 0.0595        | 141.0002 | 24708 | 27.9011         | 0.9047   | 0.7596   |
| 0.0591        | 142.0002 | 24882 | 27.4688         | 0.9048   | 0.7594   |
| 0.0535        | 143.0002 | 25056 | 25.2676         | 0.9046   | 0.7482   |
| 0.0609        | 144.0002 | 25230 | 25.6121         | 0.9093   | 0.7600   |
| 0.06          | 145.0002 | 25404 | 25.2859         | 0.9068   | 0.7641   |
| 0.0609        | 146.0002 | 25578 | 26.2561         | 0.9055   | 0.7586   |
| 0.0509        | 147.0002 | 25752 | 26.7578         | 0.9066   | 0.7604   |
| 0.0593        | 148.0002 | 25926 | 23.8757         | 0.9042   | 0.7596   |
| 0.0482        | 149.0002 | 26100 | 26.8199         | 0.9077   | 0.7605   |
| 0.0527        | 150.0002 | 26274 | 29.5701         | 0.9089   | 0.7635   |
| 0.0537        | 151.0002 | 26448 | 28.2843         | 0.9042   | 0.7597   |
| 0.0537        | 152.0002 | 26622 | 29.3675         | 0.9102   | 0.7699   |
| 0.051         | 153.0002 | 26796 | 29.8192         | 0.9026   | 0.7590   |
| 0.0522        | 154.0001 | 26970 | 28.2824         | 0.9076   | 0.7607   |
| 0.0493        | 155.0001 | 27144 | 30.5917         | 0.9036   | 0.7649   |
| 0.0571        | 156.0001 | 27318 | 26.3960         | 0.9105   | 0.7713   |
| 0.0499        | 157.0001 | 27492 | 25.1963         | 0.9082   | 0.7656   |
| 0.0488        | 158.0001 | 27666 | 24.2476         | 0.9078   | 0.7678   |
| 0.0476        | 159.0001 | 27840 | 29.2155         | 0.9073   | 0.7665   |
| 0.0438        | 160.0001 | 28014 | 33.0454         | 0.9089   | 0.7636   |
| 0.0447        | 161.0001 | 28188 | 28.9531         | 0.9045   | 0.7650   |
| 0.0489        | 162.0001 | 28362 | 29.4456         | 0.9093   | 0.7629   |
| 0.0468        | 163.0001 | 28536 | 29.0673         | 0.9077   | 0.7699   |
| 0.0574        | 164.0001 | 28710 | 28.2858         | 0.9078   | 0.7638   |
| 0.052         | 165.0001 | 28884 | 30.7560         | 0.9104   | 0.7695   |
| 0.0446        | 166.0001 | 29058 | 32.1903         | 0.9120   | 0.7749   |
| 0.0423        | 167.0001 | 29232 | 29.2310         | 0.9053   | 0.7704   |
| 0.0428        | 168.0000 | 29406 | 27.3192         | 0.9068   | 0.7716   |
| 0.0401        | 169.0000 | 29580 | 30.0189         | 0.9118   | 0.7752   |
| 0.0403        | 170.0000 | 29754 | 29.2577         | 0.9076   | 0.7678   |
| 0.0385        | 171.0000 | 29928 | 28.7694         | 0.9110   | 0.7770   |
| 0.0414        | 172.0000 | 30102 | 32.2431         | 0.9068   | 0.7689   |
| 0.0477        | 173.0000 | 30276 | 32.6876         | 0.9114   | 0.7790   |
| 0.0449        | 173.0013 | 30450 | 30.8762         | 0.9102   | 0.7700   |
| 0.0419        | 174.0013 | 30624 | 33.5587         | 0.9072   | 0.7656   |
| 0.0399        | 175.0013 | 30798 | 30.4067         | 0.9138   | 0.7762   |
| 0.0389        | 176.0013 | 30972 | 27.7398         | 0.9114   | 0.7814   |
| 0.0389        | 177.0013 | 31146 | 33.5403         | 0.9122   | 0.7762   |
| 0.0399        | 178.0013 | 31320 | 31.8017         | 0.9109   | 0.7737   |
| 0.0382        | 179.0013 | 31494 | 28.6913         | 0.9127   | 0.7795   |
| 0.0402        | 180.0012 | 31668 | 29.4478         | 0.9116   | 0.7781   |
| 0.0373        | 181.0012 | 31842 | 34.2620         | 0.9125   | 0.7794   |
| 0.0367        | 182.0012 | 32016 | 32.4342         | 0.9112   | 0.7792   |
| 0.0363        | 183.0012 | 32190 | 34.1618         | 0.9126   | 0.7802   |
| 0.0404        | 184.0012 | 32364 | 32.9724         | 0.9130   | 0.7823   |
| 0.0337        | 185.0012 | 32538 | 33.6455         | 0.9126   | 0.7772   |
| 0.0356        | 186.0012 | 32712 | 35.2180         | 0.9122   | 0.7840   |
| 0.0433        | 187.0012 | 32886 | 34.2227         | 0.9136   | 0.7786   |
| 0.0335        | 188.0012 | 33060 | 35.5376         | 0.9121   | 0.7809   |
| 0.0346        | 189.0012 | 33234 | 34.8899         | 0.9145   | 0.7868   |
| 0.0381        | 190.0012 | 33408 | 35.0377         | 0.9103   | 0.7785   |
| 0.0313        | 191.0012 | 33582 | 31.6804         | 0.9150   | 0.7833   |
| 0.0327        | 192.0012 | 33756 | 34.6929         | 0.9149   | 0.7889   |
| 0.0391        | 193.0012 | 33930 | 32.0660         | 0.9134   | 0.7873   |
| 0.0337        | 194.0011 | 34104 | 34.0592         | 0.9127   | 0.7844   |
| 0.0335        | 195.0011 | 34278 | 37.9272         | 0.9136   | 0.7845   |
| 0.0306        | 196.0011 | 34452 | 42.2947         | 0.9148   | 0.7865   |
| 0.033         | 197.0011 | 34626 | 37.4414         | 0.9156   | 0.7886   |
| 0.0313        | 198.0011 | 34800 | 38.3902         | 0.9080   | 0.7717   |
| 0.0312        | 199.0011 | 34974 | 36.9319         | 0.9129   | 0.7815   |
| 0.0404        | 200.0011 | 35148 | 36.2309         | 0.9143   | 0.7822   |
| 0.031         | 201.0011 | 35322 | 38.8410         | 0.9120   | 0.7787   |
| 0.0302        | 202.0011 | 35496 | 34.9930         | 0.9146   | 0.7842   |
| 0.0301        | 203.0011 | 35670 | 39.7052         | 0.9134   | 0.7862   |
| 0.0402        | 204.0011 | 35844 | 36.7006         | 0.9128   | 0.7874   |
| 0.038         | 205.0011 | 36018 | 36.4505         | 0.9141   | 0.7810   |
| 0.0317        | 206.0011 | 36192 | 34.7697         | 0.9159   | 0.7874   |
| 0.0321        | 207.0010 | 36366 | 40.6525         | 0.9141   | 0.7879   |
| 0.0322        | 208.0010 | 36540 | 34.3527         | 0.9141   | 0.7904   |
| 0.0272        | 209.0010 | 36714 | 36.1962         | 0.9114   | 0.7856   |
| 0.0284        | 210.0010 | 36888 | 38.4806         | 0.9120   | 0.7816   |
| 0.0286        | 211.0010 | 37062 | 42.5005         | 0.9158   | 0.7950   |
| 0.0331        | 212.0010 | 37236 | 35.1432         | 0.9147   | 0.7903   |
| 0.0318        | 213.0010 | 37410 | 41.0248         | 0.9153   | 0.7900   |
| 0.0312        | 214.0010 | 37584 | 38.7415         | 0.9144   | 0.7894   |
| 0.0262        | 215.0010 | 37758 | 39.9220         | 0.9134   | 0.7940   |
| 0.029         | 216.0010 | 37932 | 44.6415         | 0.9178   | 0.7986   |
| 0.0258        | 217.0010 | 38106 | 43.4337         | 0.9122   | 0.7833   |
| 0.0272        | 218.0010 | 38280 | 39.8874         | 0.9179   | 0.7981   |
| 0.0254        | 219.0010 | 38454 | 39.9105         | 0.9155   | 0.7950   |
| 0.0256        | 220.0010 | 38628 | 41.8861         | 0.9147   | 0.7910   |
| 0.0245        | 221.0009 | 38802 | 44.4442         | 0.9155   | 0.7917   |
| 0.0265        | 222.0009 | 38976 | 39.5973         | 0.9145   | 0.7943   |
| 0.028         | 223.0009 | 39150 | 43.7092         | 0.9114   | 0.7858   |
| 0.027         | 224.0009 | 39324 | 42.0020         | 0.9153   | 0.7907   |
| 0.0272        | 225.0009 | 39498 | 45.7376         | 0.9139   | 0.7921   |
| 0.0254        | 226.0009 | 39672 | 44.2502         | 0.9187   | 0.7975   |
| 0.0264        | 227.0009 | 39846 | 41.1210         | 0.9160   | 0.7927   |
| 0.0253        | 228.0009 | 40020 | 41.7162         | 0.9155   | 0.7940   |
| 0.0241        | 229.0009 | 40194 | 41.0619         | 0.9154   | 0.7894   |
| 0.0223        | 230.0009 | 40368 | 39.0168         | 0.9185   | 0.7974   |
| 0.0307        | 231.0009 | 40542 | 41.0393         | 0.9154   | 0.7879   |
| 0.0331        | 232.0009 | 40716 | 35.2131         | 0.9105   | 0.7871   |
| 0.0273        | 233.0009 | 40890 | 42.8387         | 0.9141   | 0.7917   |
| 0.0242        | 234.0008 | 41064 | 45.7354         | 0.9173   | 0.7991   |
| 0.025         | 235.0008 | 41238 | 46.3967         | 0.9153   | 0.7905   |
| 0.0256        | 236.0008 | 41412 | 45.8025         | 0.9185   | 0.7959   |
| 0.0227        | 237.0008 | 41586 | 37.7228         | 0.9188   | 0.8005   |
| 0.024         | 238.0008 | 41760 | 41.6256         | 0.9154   | 0.7940   |
| 0.0237        | 239.0008 | 41934 | 42.5265         | 0.9194   | 0.7950   |
| 0.0204        | 240.0008 | 42108 | 45.8603         | 0.9159   | 0.8002   |
| 0.0225        | 241.0008 | 42282 | 44.1719         | 0.9154   | 0.8019   |
| 0.0232        | 242.0008 | 42456 | 40.5801         | 0.9150   | 0.7942   |
| 0.0247        | 243.0008 | 42630 | 43.7742         | 0.9192   | 0.7948   |
| 0.0225        | 244.0008 | 42804 | 44.8745         | 0.9180   | 0.8014   |
| 0.0229        | 245.0008 | 42978 | 46.1402         | 0.9136   | 0.7943   |
| 0.0227        | 246.0008 | 43152 | 42.3056         | 0.9152   | 0.7969   |
| 0.0213        | 247.0007 | 43326 | 45.3974         | 0.9172   | 0.7970   |
| 0.0223        | 248.0007 | 43500 | 40.5924         | 0.9155   | 0.7976   |
| 0.0209        | 249.0007 | 43674 | 45.2862         | 0.9186   | 0.8044   |
| 0.0197        | 250.0007 | 43848 | 40.6883         | 0.9166   | 0.8004   |
| 0.0219        | 251.0007 | 44022 | 39.6575         | 0.9130   | 0.7957   |
| 0.0237        | 252.0007 | 44196 | 49.3599         | 0.9137   | 0.7917   |
| 0.0199        | 253.0007 | 44370 | 50.1193         | 0.9185   | 0.8009   |
| 0.019         | 254.0007 | 44544 | 41.3166         | 0.9163   | 0.8019   |
| 0.0219        | 255.0007 | 44718 | 46.5779         | 0.9207   | 0.8009   |
| 0.0206        | 256.0007 | 44892 | 44.7527         | 0.9127   | 0.7966   |
| 0.0194        | 257.0007 | 45066 | 49.2727         | 0.9131   | 0.7965   |
| 0.0226        | 258.0007 | 45240 | 48.4370         | 0.9184   | 0.7983   |
| 0.022         | 259.0007 | 45414 | 50.6521         | 0.9221   | 0.8021   |
| 0.0194        | 260.0007 | 45588 | 49.1137         | 0.9148   | 0.7994   |
| 0.0183        | 261.0006 | 45762 | 46.6812         | 0.9173   | 0.8030   |
| 0.0172        | 262.0006 | 45936 | 45.1239         | 0.9143   | 0.7965   |
| 0.0186        | 263.0006 | 46110 | 44.2976         | 0.9158   | 0.7990   |
| 0.0169        | 264.0006 | 46284 | 43.4684         | 0.9188   | 0.8025   |
| 0.0171        | 265.0006 | 46458 | 40.4181         | 0.9186   | 0.8057   |
| 0.0174        | 266.0006 | 46632 | 47.2427         | 0.9207   | 0.8026   |
| 0.0197        | 267.0006 | 46806 | 44.0242         | 0.9193   | 0.8075   |
| 0.0169        | 268.0006 | 46980 | 50.7353         | 0.9181   | 0.8018   |
| 0.0174        | 269.0006 | 47154 | 41.6724         | 0.9161   | 0.8033   |
| 0.0232        | 270.0006 | 47328 | 48.0534         | 0.9170   | 0.7970   |
| 0.019         | 271.0006 | 47502 | 40.6320         | 0.9169   | 0.8054   |
| 0.0164        | 272.0006 | 47676 | 37.8815         | 0.9190   | 0.8017   |
| 0.0163        | 273.0006 | 47850 | 52.5203         | 0.9200   | 0.8055   |
| 0.0168        | 274.0005 | 48024 | 46.4334         | 0.9215   | 0.8051   |
| 0.0166        | 275.0005 | 48198 | 40.5585         | 0.9137   | 0.8033   |
| 0.0164        | 276.0005 | 48372 | 50.2212         | 0.9195   | 0.8063   |
| 0.0215        | 277.0005 | 48546 | 44.3030         | 0.9197   | 0.8048   |
| 0.0159        | 278.0005 | 48720 | 42.1572         | 0.9222   | 0.8050   |
| 0.016         | 279.0005 | 48894 | 51.2593         | 0.9213   | 0.8050   |
| 0.018         | 280.0005 | 49068 | 44.7454         | 0.9188   | 0.8041   |
| 0.0173        | 281.0005 | 49242 | 43.4542         | 0.9168   | 0.8068   |
| 0.0191        | 282.0005 | 49416 | 46.5924         | 0.9194   | 0.8044   |
| 0.0157        | 283.0005 | 49590 | 44.6733         | 0.9179   | 0.8045   |
| 0.0196        | 284.0005 | 49764 | 43.0854         | 0.9172   | 0.8042   |
| 0.0166        | 285.0005 | 49938 | 44.7390         | 0.9189   | 0.8060   |
| 0.0172        | 286.0005 | 50112 | 47.2693         | 0.9178   | 0.8044   |
| 0.0174        | 287.0005 | 50286 | 53.2581         | 0.9244   | 0.8111   |
| 0.0163        | 288.0004 | 50460 | 48.5783         | 0.9225   | 0.8109   |
| 0.0174        | 289.0004 | 50634 | 47.9766         | 0.9169   | 0.7989   |
| 0.017         | 290.0004 | 50808 | 39.3720         | 0.9179   | 0.8043   |
| 0.0191        | 291.0004 | 50982 | 51.0921         | 0.9189   | 0.8031   |
| 0.0187        | 292.0004 | 51156 | 45.2526         | 0.9194   | 0.8086   |
| 0.0153        | 293.0004 | 51330 | 44.2389         | 0.9175   | 0.7999   |
| 0.0151        | 294.0004 | 51504 | 46.3420         | 0.9202   | 0.8101   |
| 0.0134        | 295.0004 | 51678 | 47.7280         | 0.9190   | 0.8114   |
| 0.0156        | 296.0004 | 51852 | 47.6905         | 0.9206   | 0.8114   |
| 0.0282        | 297.0004 | 52026 | 43.2852         | 0.9204   | 0.8068   |
| 0.0159        | 298.0004 | 52200 | 46.9971         | 0.9206   | 0.8100   |
| 0.0141        | 299.0004 | 52374 | 51.8185         | 0.9188   | 0.8045   |
| 0.0166        | 300.0004 | 52548 | 48.0788         | 0.9211   | 0.8087   |
| 0.0148        | 301.0003 | 52722 | 49.4335         | 0.9205   | 0.8083   |
| 0.0157        | 302.0003 | 52896 | 50.3780         | 0.9183   | 0.8124   |
| 0.0134        | 303.0003 | 53070 | 47.6538         | 0.9207   | 0.8102   |
| 0.0143        | 304.0003 | 53244 | 46.0681         | 0.9209   | 0.8126   |
| 0.0163        | 305.0003 | 53418 | 48.9220         | 0.9213   | 0.8106   |
| 0.0146        | 306.0003 | 53592 | 51.5249         | 0.9204   | 0.8137   |
| 0.0136        | 307.0003 | 53766 | 45.6814         | 0.9178   | 0.8120   |
| 0.0164        | 308.0003 | 53940 | 52.3002         | 0.9225   | 0.8137   |
| 0.0146        | 309.0003 | 54114 | 46.8648         | 0.9212   | 0.8149   |
| 0.0136        | 310.0003 | 54288 | 48.7125         | 0.9200   | 0.8128   |
| 0.0179        | 311.0003 | 54462 | 41.3506         | 0.9209   | 0.8171   |
| 0.0124        | 312.0003 | 54636 | 51.8990         | 0.9192   | 0.8096   |
| 0.0132        | 313.0003 | 54810 | 47.2966         | 0.9191   | 0.8106   |
| 0.0132        | 314.0003 | 54984 | 45.8575         | 0.9188   | 0.8086   |
| 0.013         | 315.0002 | 55158 | 49.4688         | 0.9204   | 0.8143   |
| 0.0144        | 316.0002 | 55332 | 57.6538         | 0.9217   | 0.8180   |
| 0.0131        | 317.0002 | 55506 | 44.4522         | 0.9206   | 0.8119   |
| 0.0133        | 318.0002 | 55680 | 43.5448         | 0.9194   | 0.8086   |
| 0.0155        | 319.0002 | 55854 | 48.6718         | 0.9190   | 0.8133   |
| 0.0116        | 320.0002 | 56028 | 45.8694         | 0.9204   | 0.8154   |
| 0.014         | 321.0002 | 56202 | 47.1119         | 0.9202   | 0.8185   |
| 0.0121        | 322.0002 | 56376 | 48.6683         | 0.9225   | 0.8147   |
| 0.0162        | 323.0002 | 56550 | 45.9671         | 0.9198   | 0.8160   |
| 0.0122        | 324.0002 | 56724 | 41.4543         | 0.9170   | 0.8052   |
| 0.0136        | 325.0002 | 56898 | 54.9324         | 0.9192   | 0.8120   |
| 0.0136        | 326.0002 | 57072 | 47.6662         | 0.9178   | 0.8088   |
| 0.0156        | 327.0002 | 57246 | 44.9812         | 0.9210   | 0.8148   |
| 0.0119        | 328.0001 | 57420 | 50.5898         | 0.9224   | 0.8182   |
| 0.0109        | 329.0001 | 57594 | 41.1393         | 0.9233   | 0.8167   |
| 0.0119        | 330.0001 | 57768 | 42.6528         | 0.9230   | 0.8160   |
| 0.0121        | 331.0001 | 57942 | 52.7989         | 0.9229   | 0.8188   |
| 0.0179        | 332.0001 | 58116 | 43.9294         | 0.9229   | 0.8172   |
| 0.0118        | 333.0001 | 58290 | 39.4643         | 0.9252   | 0.8229   |
| 0.0115        | 334.0001 | 58464 | 40.9815         | 0.9223   | 0.8158   |
| 0.0109        | 335.0001 | 58638 | 48.3108         | 0.9183   | 0.8132   |
| 0.0112        | 336.0001 | 58812 | 48.5857         | 0.9215   | 0.8171   |
| 0.0106        | 337.0001 | 58986 | 36.4734         | 0.9212   | 0.8189   |
| 0.0102        | 338.0001 | 59160 | 43.8731         | 0.9225   | 0.8174   |
| 0.011         | 339.0001 | 59334 | 40.7358         | 0.9185   | 0.8114   |
| 0.0104        | 340.0001 | 59508 | 46.0921         | 0.9206   | 0.8154   |
| 0.0098        | 341.0001 | 59682 | 50.6993         | 0.9219   | 0.8208   |
| 0.0107        | 342.0000 | 59856 | 52.0383         | 0.9201   | 0.8135   |
| 0.01          | 343.0000 | 60030 | 43.7557         | 0.9223   | 0.8197   |
| 0.0115        | 344.0000 | 60204 | 52.4058         | 0.9191   | 0.8140   |
| 0.0117        | 345.0000 | 60378 | 41.0957         | 0.9193   | 0.8144   |
| 0.0119        | 346.0000 | 60552 | 44.4985         | 0.9221   | 0.8223   |
| 0.014         | 347.0000 | 60726 | 48.4668         | 0.9232   | 0.8130   |
| 0.0116        | 347.0013 | 60900 | 45.1996         | 0.9208   | 0.8205   |
| 0.01          | 348.0013 | 61074 | 44.5869         | 0.9202   | 0.8174   |
| 0.0106        | 349.0013 | 61248 | 44.1820         | 0.9226   | 0.8207   |
| 0.0136        | 350.0013 | 61422 | 42.0940         | 0.9234   | 0.8225   |
| 0.0097        | 351.0013 | 61596 | 40.7979         | 0.9213   | 0.8169   |
| 0.0094        | 352.0013 | 61770 | 40.2062         | 0.9218   | 0.8173   |


### Framework versions

- Transformers 4.46.0
- Pytorch 2.3.1+cu121
- Datasets 2.20.0
- Tokenizers 0.20.1