--- library_name: transformers tags: - generated_from_trainer metrics: - accuracy model-index: - name: ht-stmini-cls-v6_ftis_noPretrain-cssl-npsNonennsNone results: [] --- # ht-stmini-cls-v6_ftis_noPretrain-cssl-npsNonennsNone This model is a fine-tuned version of [](https://huggingface.co/) on an unknown dataset. It achieves the following results on the evaluation set: - Loss: 40.7884 - Accuracy: 0.9243 - Macro F1: 0.8257 ## Model description More information needed ## Intended uses & limitations More information needed ## Training and evaluation data More information needed ## Training procedure ### Training hyperparameters The following hyperparameters were used during training: - learning_rate: 0.0001 - train_batch_size: 8 - eval_batch_size: 4 - seed: 42 - optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments - lr_scheduler_type: linear - lr_scheduler_warmup_steps: 6733 - training_steps: 134674 ### Training results | Training Loss | Epoch | Step | Validation Loss | Accuracy | Macro F1 | |:-------------:|:--------:|:-----:|:---------------:|:--------:|:--------:| | 1018.9662 | 0.0013 | 174 | 886.7844 | 0.0198 | 0.0149 | | 260.1557 | 1.0013 | 348 | 169.5858 | 0.0300 | 0.0189 | | 92.2633 | 2.0013 | 522 | 209.2763 | 0.0964 | 0.0395 | | 76.7039 | 3.0013 | 696 | 233.4833 | 0.2778 | 0.0855 | | 67.6178 | 4.0013 | 870 | 260.0321 | 0.3898 | 0.1045 | | 63.425 | 5.0013 | 1044 | 272.0145 | 0.4480 | 0.1135 | | 58.8917 | 6.0012 | 1218 | 236.8829 | 0.4785 | 0.1198 | | 56.2551 | 7.0012 | 1392 | 252.6687 | 0.5018 | 0.1256 | | 52.6558 | 8.0012 | 1566 | 247.7192 | 0.5149 | 0.1278 | | 50.3826 | 9.0012 | 1740 | 231.8920 | 0.5282 | 0.1305 | | 46.9564 | 10.0012 | 1914 | 209.5314 | 0.5358 | 0.1327 | | 45.2094 | 11.0012 | 2088 | 168.8370 | 0.5424 | 0.1347 | | 43.9985 | 12.0012 | 2262 | 155.1592 | 0.5501 | 0.1369 | | 41.8779 | 13.0012 | 2436 | 145.9524 | 0.5555 | 0.1394 | | 40.0767 | 14.0012 | 2610 | 127.8297 | 0.5675 | 0.1431 | | 38.1067 | 15.0012 | 2784 | 121.9333 | 0.5652 | 0.1444 | | 36.2789 | 16.0012 | 2958 | 116.3361 | 0.5808 | 0.1483 | | 34.707 | 17.0012 | 3132 | 113.5129 | 0.5841 | 0.1514 | | 32.6286 | 18.0012 | 3306 | 100.3719 | 0.5823 | 0.1540 | | 31.0396 | 19.0012 | 3480 | 96.5273 | 0.6127 | 0.1615 | | 29.2648 | 20.0011 | 3654 | 87.1845 | 0.5916 | 0.1618 | | 27.4653 | 21.0011 | 3828 | 87.9639 | 0.6149 | 0.1702 | | 25.9322 | 22.0011 | 4002 | 83.5998 | 0.6226 | 0.1740 | | 25.0015 | 23.0011 | 4176 | 76.7936 | 0.6274 | 0.1786 | | 23.239 | 24.0011 | 4350 | 73.2435 | 0.6334 | 0.1863 | | 21.1758 | 25.0011 | 4524 | 69.9750 | 0.6515 | 0.1928 | | 20.4033 | 26.0011 | 4698 | 69.3632 | 0.6559 | 0.2018 | | 19.0828 | 27.0011 | 4872 | 65.5585 | 0.6732 | 0.2105 | | 17.8379 | 28.0011 | 5046 | 68.3849 | 0.6598 | 0.2107 | | 16.806 | 29.0011 | 5220 | 67.3053 | 0.6870 | 0.2336 | | 15.8098 | 30.0011 | 5394 | 67.1000 | 0.6966 | 0.2431 | | 14.6465 | 31.0011 | 5568 | 65.0158 | 0.7007 | 0.2505 | | 14.6235 | 32.0011 | 5742 | 66.2654 | 0.7026 | 0.2705 | | 12.8541 | 33.0010 | 5916 | 60.0147 | 0.7198 | 0.2821 | | 12.2155 | 34.0010 | 6090 | 64.4097 | 0.7142 | 0.2946 | | 11.079 | 35.0010 | 6264 | 71.2552 | 0.7257 | 0.3151 | | 10.6081 | 36.0010 | 6438 | 59.0161 | 0.7379 | 0.3308 | | 9.5348 | 37.0010 | 6612 | 60.7884 | 0.7384 | 0.3389 | | 9.2133 | 38.0010 | 6786 | 70.0338 | 0.7327 | 0.3431 | | 8.4618 | 39.0010 | 6960 | 69.3644 | 0.7620 | 0.3837 | | 7.687 | 40.0010 | 7134 | 65.8650 | 0.7604 | 0.3924 | | 7.302 | 41.0010 | 7308 | 73.2410 | 0.7484 | 0.3919 | | 6.8601 | 42.0010 | 7482 | 69.8922 | 0.7643 | 0.4064 | | 6.2672 | 43.0010 | 7656 | 77.1577 | 0.7683 | 0.4304 | | 5.8914 | 44.0010 | 7830 | 79.3618 | 0.7787 | 0.4392 | | 5.4441 | 45.0010 | 8004 | 77.0051 | 0.7817 | 0.4421 | | 4.8487 | 46.0010 | 8178 | 74.3146 | 0.7753 | 0.4223 | | 4.7 | 47.0009 | 8352 | 84.9412 | 0.7752 | 0.4574 | | 4.2161 | 48.0009 | 8526 | 79.8605 | 0.7920 | 0.4652 | | 3.938 | 49.0009 | 8700 | 93.0963 | 0.7918 | 0.4745 | | 3.6042 | 50.0009 | 8874 | 83.2228 | 0.7920 | 0.4812 | | 3.8992 | 51.0009 | 9048 | 89.5597 | 0.7905 | 0.4837 | | 3.3032 | 52.0009 | 9222 | 98.1545 | 0.7950 | 0.4888 | | 2.9014 | 53.0009 | 9396 | 85.2156 | 0.8015 | 0.4993 | | 2.7841 | 54.0009 | 9570 | 92.0802 | 0.8068 | 0.5043 | | 2.6213 | 55.0009 | 9744 | 85.6675 | 0.8035 | 0.5110 | | 2.2634 | 56.0009 | 9918 | 74.9206 | 0.8148 | 0.5233 | | 2.1124 | 57.0009 | 10092 | 81.3580 | 0.8099 | 0.5260 | | 2.0714 | 58.0009 | 10266 | 86.4350 | 0.8164 | 0.5352 | | 1.8392 | 59.0009 | 10440 | 86.3464 | 0.8132 | 0.5342 | | 1.7849 | 60.0008 | 10614 | 87.1245 | 0.8194 | 0.5396 | | 1.6399 | 61.0008 | 10788 | 89.5386 | 0.8224 | 0.5466 | | 1.5521 | 62.0008 | 10962 | 91.3810 | 0.8244 | 0.5510 | | 1.4438 | 63.0008 | 11136 | 86.5743 | 0.8203 | 0.5549 | | 1.2801 | 64.0008 | 11310 | 84.8941 | 0.8171 | 0.5585 | | 1.2622 | 65.0008 | 11484 | 85.4980 | 0.8270 | 0.5627 | | 1.0652 | 66.0008 | 11658 | 88.8211 | 0.8345 | 0.5733 | | 1.035 | 67.0008 | 11832 | 85.3294 | 0.8378 | 0.5732 | | 0.7858 | 68.0008 | 12006 | 82.8821 | 0.8411 | 0.5695 | | 0.6972 | 69.0008 | 12180 | 68.7403 | 0.8341 | 0.5727 | | 0.6212 | 70.0008 | 12354 | 66.5168 | 0.8418 | 0.5867 | | 0.5844 | 71.0008 | 12528 | 68.1539 | 0.8526 | 0.6040 | | 0.599 | 72.0008 | 12702 | 79.1106 | 0.8496 | 0.5988 | | 0.4673 | 73.0007 | 12876 | 81.5766 | 0.8510 | 0.6012 | | 0.4342 | 74.0007 | 13050 | 73.8607 | 0.8526 | 0.6041 | | 0.3797 | 75.0007 | 13224 | 90.0665 | 0.8632 | 0.6271 | | 0.3808 | 76.0007 | 13398 | 70.5542 | 0.8611 | 0.6198 | | 0.3669 | 77.0007 | 13572 | 74.3435 | 0.8638 | 0.6302 | | 0.3163 | 78.0007 | 13746 | 84.7883 | 0.8633 | 0.6299 | | 0.298 | 79.0007 | 13920 | 69.2689 | 0.8668 | 0.6463 | | 0.3132 | 80.0007 | 14094 | 70.1329 | 0.8697 | 0.6379 | | 0.2811 | 81.0007 | 14268 | 67.5573 | 0.8760 | 0.6616 | | 0.271 | 82.0007 | 14442 | 69.8341 | 0.8750 | 0.6555 | | 0.2551 | 83.0007 | 14616 | 63.4394 | 0.8758 | 0.6640 | | 0.2323 | 84.0007 | 14790 | 63.1980 | 0.8758 | 0.6711 | | 0.2377 | 85.0007 | 14964 | 55.2516 | 0.8818 | 0.6825 | | 0.2357 | 86.0007 | 15138 | 54.5628 | 0.8809 | 0.6770 | | 0.2198 | 87.0006 | 15312 | 53.7477 | 0.8791 | 0.6739 | | 0.1897 | 88.0006 | 15486 | 50.4791 | 0.8846 | 0.6838 | | 0.1923 | 89.0006 | 15660 | 48.7978 | 0.8849 | 0.6880 | | 0.1869 | 90.0006 | 15834 | 54.0512 | 0.8886 | 0.6959 | | 0.1963 | 91.0006 | 16008 | 46.0196 | 0.8896 | 0.6958 | | 0.1852 | 92.0006 | 16182 | 44.5894 | 0.8885 | 0.6940 | | 0.1781 | 93.0006 | 16356 | 47.1554 | 0.8916 | 0.7032 | | 0.1851 | 94.0006 | 16530 | 41.2292 | 0.8926 | 0.7069 | | 0.1615 | 95.0006 | 16704 | 39.1126 | 0.8867 | 0.6943 | | 0.1579 | 96.0006 | 16878 | 39.6779 | 0.8919 | 0.7096 | | 0.155 | 97.0006 | 17052 | 38.8228 | 0.8944 | 0.7121 | | 0.1467 | 98.0006 | 17226 | 39.5075 | 0.8964 | 0.7181 | | 0.1374 | 99.0006 | 17400 | 38.7291 | 0.8968 | 0.7130 | | 0.1325 | 100.0005 | 17574 | 36.1005 | 0.8957 | 0.7197 | | 0.1574 | 101.0005 | 17748 | 36.6316 | 0.8935 | 0.7188 | | 0.1377 | 102.0005 | 17922 | 35.5663 | 0.8989 | 0.7269 | | 0.1213 | 103.0005 | 18096 | 36.8527 | 0.8963 | 0.7199 | | 0.1178 | 104.0005 | 18270 | 35.0816 | 0.8956 | 0.7240 | | 0.1223 | 105.0005 | 18444 | 33.3822 | 0.8973 | 0.7302 | | 0.1143 | 106.0005 | 18618 | 34.4991 | 0.9013 | 0.7281 | | 0.1162 | 107.0005 | 18792 | 38.1654 | 0.8947 | 0.7272 | | 0.1144 | 108.0005 | 18966 | 35.0182 | 0.8991 | 0.7315 | | 0.1108 | 109.0005 | 19140 | 28.5894 | 0.8990 | 0.7368 | | 0.0982 | 110.0005 | 19314 | 31.3832 | 0.9005 | 0.7343 | | 0.1101 | 111.0005 | 19488 | 29.4827 | 0.8963 | 0.7235 | | 0.101 | 112.0005 | 19662 | 32.0108 | 0.8996 | 0.7351 | | 0.0927 | 113.0005 | 19836 | 29.9814 | 0.9023 | 0.7465 | | 0.0939 | 114.0004 | 20010 | 31.9251 | 0.8987 | 0.7409 | | 0.1128 | 115.0004 | 20184 | 29.2695 | 0.9035 | 0.7401 | | 0.0948 | 116.0004 | 20358 | 29.4713 | 0.9080 | 0.7524 | | 0.0958 | 117.0004 | 20532 | 30.9108 | 0.9072 | 0.7512 | | 0.0994 | 118.0004 | 20706 | 30.8078 | 0.9079 | 0.7461 | | 0.0838 | 119.0004 | 20880 | 30.8132 | 0.9043 | 0.7498 | | 0.0866 | 120.0004 | 21054 | 28.0283 | 0.9087 | 0.7585 | | 0.0767 | 121.0004 | 21228 | 28.5761 | 0.9069 | 0.7515 | | 0.0772 | 122.0004 | 21402 | 29.3468 | 0.9049 | 0.7541 | | 0.0781 | 123.0004 | 21576 | 27.6131 | 0.9098 | 0.7522 | | 0.0805 | 124.0004 | 21750 | 27.9194 | 0.9075 | 0.7550 | | 0.0746 | 125.0004 | 21924 | 31.4375 | 0.9070 | 0.7578 | | 0.0788 | 126.0004 | 22098 | 27.3451 | 0.9083 | 0.7531 | | 0.0737 | 127.0003 | 22272 | 28.9915 | 0.9083 | 0.7575 | | 0.0669 | 128.0003 | 22446 | 28.4092 | 0.9054 | 0.7559 | | 0.0706 | 129.0003 | 22620 | 28.8784 | 0.9045 | 0.7594 | | 0.0777 | 130.0003 | 22794 | 29.9340 | 0.9050 | 0.7527 | | 0.0682 | 131.0003 | 22968 | 27.1804 | 0.9087 | 0.7654 | | 0.0636 | 132.0003 | 23142 | 28.4850 | 0.9028 | 0.7522 | | 0.0698 | 133.0003 | 23316 | 27.9855 | 0.9040 | 0.7590 | | 0.0642 | 134.0003 | 23490 | 28.2706 | 0.9041 | 0.7623 | | 0.062 | 135.0003 | 23664 | 27.2285 | 0.9103 | 0.7597 | | 0.0795 | 136.0003 | 23838 | 28.2042 | 0.9042 | 0.7552 | | 0.0665 | 137.0003 | 24012 | 29.0280 | 0.9095 | 0.7672 | | 0.0669 | 138.0003 | 24186 | 28.1774 | 0.9105 | 0.7671 | | 0.0553 | 139.0003 | 24360 | 28.3465 | 0.9087 | 0.7646 | | 0.0615 | 140.0003 | 24534 | 24.3288 | 0.9045 | 0.7595 | | 0.0559 | 141.0002 | 24708 | 28.0275 | 0.9069 | 0.7623 | | 0.0575 | 142.0002 | 24882 | 28.1520 | 0.9120 | 0.7707 | | 0.0519 | 143.0002 | 25056 | 24.7488 | 0.9117 | 0.7646 | | 0.0649 | 144.0002 | 25230 | 27.5287 | 0.9080 | 0.7643 | | 0.0534 | 145.0002 | 25404 | 25.1958 | 0.9107 | 0.7729 | | 0.0605 | 146.0002 | 25578 | 29.7407 | 0.9079 | 0.7719 | | 0.0522 | 147.0002 | 25752 | 25.2261 | 0.9095 | 0.7665 | | 0.0541 | 148.0002 | 25926 | 23.2289 | 0.9109 | 0.7741 | | 0.0499 | 149.0002 | 26100 | 28.1476 | 0.9094 | 0.7638 | | 0.0508 | 150.0002 | 26274 | 31.8322 | 0.9103 | 0.7711 | | 0.0461 | 151.0002 | 26448 | 27.6077 | 0.9114 | 0.7682 | | 0.0521 | 152.0002 | 26622 | 29.3119 | 0.9096 | 0.7713 | | 0.0473 | 153.0002 | 26796 | 32.7875 | 0.9128 | 0.7741 | | 0.0512 | 154.0001 | 26970 | 28.5612 | 0.9084 | 0.7684 | | 0.0461 | 155.0001 | 27144 | 30.1035 | 0.9079 | 0.7690 | | 0.0513 | 156.0001 | 27318 | 28.6743 | 0.9101 | 0.7704 | | 0.0498 | 157.0001 | 27492 | 26.8469 | 0.9120 | 0.7756 | | 0.0471 | 158.0001 | 27666 | 26.8248 | 0.9152 | 0.7823 | | 0.0465 | 159.0001 | 27840 | 28.2316 | 0.9087 | 0.7800 | | 0.0403 | 160.0001 | 28014 | 32.8010 | 0.9127 | 0.7829 | | 0.047 | 161.0001 | 28188 | 30.5850 | 0.9140 | 0.7815 | | 0.0451 | 162.0001 | 28362 | 29.7165 | 0.9133 | 0.7844 | | 0.0467 | 163.0001 | 28536 | 28.8729 | 0.9139 | 0.7794 | | 0.0398 | 164.0001 | 28710 | 31.4360 | 0.9116 | 0.7788 | | 0.042 | 165.0001 | 28884 | 30.3772 | 0.9144 | 0.7822 | | 0.0416 | 166.0001 | 29058 | 30.5408 | 0.9106 | 0.7787 | | 0.0403 | 167.0001 | 29232 | 31.3930 | 0.9111 | 0.7756 | | 0.0403 | 168.0000 | 29406 | 29.1180 | 0.9149 | 0.7884 | | 0.0417 | 169.0000 | 29580 | 30.5529 | 0.9101 | 0.7784 | | 0.0419 | 170.0000 | 29754 | 30.0614 | 0.9144 | 0.7812 | | 0.0381 | 171.0000 | 29928 | 31.8392 | 0.9124 | 0.7817 | | 0.0373 | 172.0000 | 30102 | 33.8253 | 0.9164 | 0.7864 | | 0.0384 | 173.0000 | 30276 | 30.3109 | 0.9157 | 0.7854 | | 0.0392 | 173.0013 | 30450 | 28.9327 | 0.9138 | 0.7878 | | 0.043 | 174.0013 | 30624 | 35.1833 | 0.9170 | 0.7885 | | 0.0379 | 175.0013 | 30798 | 31.9109 | 0.9121 | 0.7828 | | 0.0374 | 176.0013 | 30972 | 31.8274 | 0.9162 | 0.7851 | | 0.0376 | 177.0013 | 31146 | 34.9213 | 0.9144 | 0.7823 | | 0.0365 | 178.0013 | 31320 | 28.4904 | 0.9138 | 0.7866 | | 0.0361 | 179.0013 | 31494 | 29.5490 | 0.9120 | 0.7864 | | 0.0395 | 180.0012 | 31668 | 31.0823 | 0.9128 | 0.7883 | | 0.0365 | 181.0012 | 31842 | 31.8953 | 0.9113 | 0.7811 | | 0.0325 | 182.0012 | 32016 | 35.8794 | 0.9168 | 0.7887 | | 0.0385 | 183.0012 | 32190 | 35.0481 | 0.9160 | 0.7900 | | 0.0352 | 184.0012 | 32364 | 34.3527 | 0.9174 | 0.7862 | | 0.0335 | 185.0012 | 32538 | 39.8445 | 0.9130 | 0.7827 | | 0.0378 | 186.0012 | 32712 | 33.3658 | 0.9116 | 0.7824 | | 0.031 | 187.0012 | 32886 | 34.4493 | 0.9144 | 0.7813 | | 0.0332 | 188.0012 | 33060 | 38.3441 | 0.9138 | 0.7825 | | 0.039 | 189.0012 | 33234 | 33.8854 | 0.9168 | 0.7854 | | 0.0324 | 190.0012 | 33408 | 31.5700 | 0.9152 | 0.7875 | | 0.0317 | 191.0012 | 33582 | 33.9902 | 0.9164 | 0.7911 | | 0.0327 | 192.0012 | 33756 | 32.1424 | 0.9142 | 0.7878 | | 0.0292 | 193.0012 | 33930 | 31.2490 | 0.9164 | 0.7926 | | 0.0329 | 194.0011 | 34104 | 32.2469 | 0.9141 | 0.7855 | | 0.0298 | 195.0011 | 34278 | 37.8325 | 0.9148 | 0.7925 | | 0.0344 | 196.0011 | 34452 | 44.5697 | 0.9156 | 0.7935 | | 0.037 | 197.0011 | 34626 | 42.9465 | 0.9142 | 0.7902 | | 0.0317 | 198.0011 | 34800 | 38.2621 | 0.9144 | 0.7896 | | 0.0315 | 199.0011 | 34974 | 33.9128 | 0.9166 | 0.7965 | | 0.0367 | 200.0011 | 35148 | 40.8834 | 0.9134 | 0.7904 | | 0.0317 | 201.0011 | 35322 | 38.1472 | 0.9125 | 0.7901 | | 0.0311 | 202.0011 | 35496 | 34.7823 | 0.9162 | 0.7957 | | 0.0284 | 203.0011 | 35670 | 42.8945 | 0.9156 | 0.7960 | | 0.0382 | 204.0011 | 35844 | 36.7848 | 0.9176 | 0.7995 | | 0.0306 | 205.0011 | 36018 | 36.0606 | 0.9166 | 0.7920 | | 0.028 | 206.0011 | 36192 | 35.6608 | 0.9158 | 0.7982 | | 0.0285 | 207.0010 | 36366 | 41.6987 | 0.9150 | 0.7958 | | 0.0317 | 208.0010 | 36540 | 33.5806 | 0.9170 | 0.7990 | | 0.0283 | 209.0010 | 36714 | 35.6250 | 0.9199 | 0.8000 | | 0.0309 | 210.0010 | 36888 | 36.3838 | 0.9174 | 0.7941 | | 0.0258 | 211.0010 | 37062 | 36.8173 | 0.9139 | 0.7939 | | 0.0314 | 212.0010 | 37236 | 35.0685 | 0.9176 | 0.7974 | | 0.0285 | 213.0010 | 37410 | 36.3840 | 0.9157 | 0.7895 | | 0.031 | 214.0010 | 37584 | 35.1128 | 0.9203 | 0.8025 | | 0.026 | 215.0010 | 37758 | 42.5573 | 0.9177 | 0.8015 | | 0.0273 | 216.0010 | 37932 | 36.4697 | 0.9176 | 0.8024 | | 0.0269 | 217.0010 | 38106 | 44.6008 | 0.9175 | 0.8026 | | 0.0266 | 218.0010 | 38280 | 42.0365 | 0.9198 | 0.8053 | | 0.0248 | 219.0010 | 38454 | 44.5621 | 0.9157 | 0.7972 | | 0.0251 | 220.0010 | 38628 | 43.1368 | 0.9205 | 0.7978 | | 0.0236 | 221.0009 | 38802 | 43.3885 | 0.9204 | 0.8031 | | 0.0244 | 222.0009 | 38976 | 41.2801 | 0.9221 | 0.8059 | | 0.0431 | 223.0009 | 39150 | 41.6193 | 0.9157 | 0.8031 | | 0.0246 | 224.0009 | 39324 | 46.4354 | 0.9214 | 0.8031 | | 0.0265 | 225.0009 | 39498 | 43.7890 | 0.9194 | 0.8041 | | 0.0235 | 226.0009 | 39672 | 39.6297 | 0.9157 | 0.7994 | | 0.0328 | 227.0009 | 39846 | 38.3734 | 0.9188 | 0.8046 | | 0.0249 | 228.0009 | 40020 | 41.2767 | 0.9241 | 0.8076 | | 0.0245 | 229.0009 | 40194 | 44.5471 | 0.9188 | 0.8017 | | 0.0217 | 230.0009 | 40368 | 41.3734 | 0.9187 | 0.8088 | | 0.0226 | 231.0009 | 40542 | 32.6611 | 0.9169 | 0.8049 | | 0.0222 | 232.0009 | 40716 | 37.6578 | 0.9164 | 0.8048 | | 0.0264 | 233.0009 | 40890 | 39.2974 | 0.9192 | 0.8044 | | 0.0248 | 234.0008 | 41064 | 42.4516 | 0.9187 | 0.8109 | | 0.0213 | 235.0008 | 41238 | 49.0873 | 0.9204 | 0.8081 | | 0.025 | 236.0008 | 41412 | 46.7521 | 0.9186 | 0.8100 | | 0.0231 | 237.0008 | 41586 | 39.6638 | 0.9198 | 0.8070 | | 0.0218 | 238.0008 | 41760 | 46.5629 | 0.9207 | 0.8106 | | 0.0206 | 239.0008 | 41934 | 42.5562 | 0.9145 | 0.7911 | | 0.0222 | 240.0008 | 42108 | 43.5052 | 0.9189 | 0.8116 | | 0.0221 | 241.0008 | 42282 | 44.5935 | 0.9182 | 0.8130 | | 0.0276 | 242.0008 | 42456 | 40.4864 | 0.9185 | 0.8042 | | 0.0227 | 243.0008 | 42630 | 45.2802 | 0.9215 | 0.8131 | | 0.0222 | 244.0008 | 42804 | 39.6941 | 0.9164 | 0.8017 | | 0.0229 | 245.0008 | 42978 | 48.1347 | 0.9191 | 0.8080 | | 0.0206 | 246.0008 | 43152 | 45.4992 | 0.9184 | 0.8039 | | 0.0216 | 247.0007 | 43326 | 46.9400 | 0.9213 | 0.8128 | | 0.0286 | 248.0007 | 43500 | 40.8032 | 0.9157 | 0.7976 | | 0.0216 | 249.0007 | 43674 | 50.4272 | 0.9182 | 0.8028 | | 0.0203 | 250.0007 | 43848 | 42.4235 | 0.9233 | 0.8109 | | 0.0203 | 251.0007 | 44022 | 45.4216 | 0.9189 | 0.8071 | | 0.0203 | 252.0007 | 44196 | 48.3934 | 0.9161 | 0.8013 | | 0.0248 | 253.0007 | 44370 | 52.3558 | 0.9190 | 0.8059 | | 0.018 | 254.0007 | 44544 | 45.4758 | 0.9205 | 0.8065 | | 0.0193 | 255.0007 | 44718 | 48.0583 | 0.9184 | 0.8104 | | 0.0203 | 256.0007 | 44892 | 48.5592 | 0.9193 | 0.8033 | | 0.0228 | 257.0007 | 45066 | 44.8186 | 0.9173 | 0.8077 | | 0.0205 | 258.0007 | 45240 | 50.3237 | 0.9208 | 0.8111 | | 0.0188 | 259.0007 | 45414 | 51.8498 | 0.9183 | 0.8083 | | 0.0193 | 260.0007 | 45588 | 50.2069 | 0.9210 | 0.8134 | | 0.0174 | 261.0006 | 45762 | 46.1694 | 0.9192 | 0.8047 | | 0.0176 | 262.0006 | 45936 | 47.8511 | 0.9202 | 0.8058 | | 0.0186 | 263.0006 | 46110 | 43.7265 | 0.9192 | 0.8092 | | 0.034 | 264.0006 | 46284 | 42.5060 | 0.9184 | 0.8065 | | 0.016 | 265.0006 | 46458 | 44.8083 | 0.9199 | 0.8148 | | 0.0191 | 266.0006 | 46632 | 44.8833 | 0.9162 | 0.8146 | | 0.0182 | 267.0006 | 46806 | 45.0517 | 0.9227 | 0.8173 | | 0.0182 | 268.0006 | 46980 | 49.5023 | 0.9224 | 0.8113 | | 0.0184 | 269.0006 | 47154 | 40.9736 | 0.9212 | 0.8089 | | 0.0176 | 270.0006 | 47328 | 46.9918 | 0.9218 | 0.8145 | | 0.0182 | 271.0006 | 47502 | 43.0739 | 0.9215 | 0.8145 | | 0.0188 | 272.0006 | 47676 | 39.2271 | 0.9198 | 0.8146 | | 0.0168 | 273.0006 | 47850 | 50.6478 | 0.9219 | 0.8118 | | 0.0151 | 274.0005 | 48024 | 50.0297 | 0.9205 | 0.8081 | | 0.0167 | 275.0005 | 48198 | 44.5762 | 0.9223 | 0.8109 | | 0.0171 | 276.0005 | 48372 | 46.3786 | 0.9193 | 0.8106 | | 0.0182 | 277.0005 | 48546 | 44.3470 | 0.9224 | 0.8196 | | 0.0183 | 278.0005 | 48720 | 45.9944 | 0.9209 | 0.8156 | | 0.0172 | 279.0005 | 48894 | 49.1469 | 0.9201 | 0.8161 | | 0.0171 | 280.0005 | 49068 | 48.3005 | 0.9184 | 0.8173 | | 0.0161 | 281.0005 | 49242 | 53.2503 | 0.9195 | 0.8069 | | 0.0181 | 282.0005 | 49416 | 46.3198 | 0.9242 | 0.8108 | | 0.0165 | 283.0005 | 49590 | 50.3036 | 0.9216 | 0.8124 | | 0.0164 | 284.0005 | 49764 | 46.9534 | 0.9212 | 0.8044 | | 0.0161 | 285.0005 | 49938 | 53.2531 | 0.9231 | 0.8155 | | 0.0146 | 286.0005 | 50112 | 47.1529 | 0.9235 | 0.8154 | | 0.0161 | 287.0005 | 50286 | 53.1931 | 0.9231 | 0.8161 | | 0.0157 | 288.0004 | 50460 | 52.0873 | 0.9189 | 0.8088 | | 0.0157 | 289.0004 | 50634 | 49.2416 | 0.9242 | 0.8156 | | 0.0164 | 290.0004 | 50808 | 46.4858 | 0.9236 | 0.8196 | | 0.0163 | 291.0004 | 50982 | 48.2724 | 0.9163 | 0.8128 | | 0.0146 | 292.0004 | 51156 | 49.6423 | 0.9203 | 0.8131 | | 0.0155 | 293.0004 | 51330 | 43.2196 | 0.9218 | 0.8189 | | 0.0166 | 294.0004 | 51504 | 44.7102 | 0.9227 | 0.8191 | | 0.0165 | 295.0004 | 51678 | 55.8850 | 0.9189 | 0.8083 | | 0.015 | 296.0004 | 51852 | 48.0222 | 0.9171 | 0.8097 | | 0.0158 | 297.0004 | 52026 | 45.1064 | 0.9208 | 0.8114 | | 0.0151 | 298.0004 | 52200 | 49.6042 | 0.9191 | 0.8055 | | 0.017 | 299.0004 | 52374 | 54.4554 | 0.9241 | 0.8169 | | 0.0157 | 300.0004 | 52548 | 42.7263 | 0.9205 | 0.8151 | | 0.0164 | 301.0003 | 52722 | 43.3817 | 0.9214 | 0.8120 | | 0.014 | 302.0003 | 52896 | 49.3860 | 0.9195 | 0.8142 | | 0.0125 | 303.0003 | 53070 | 46.0132 | 0.9231 | 0.8178 | | 0.0155 | 304.0003 | 53244 | 53.5160 | 0.9223 | 0.8194 | | 0.0153 | 305.0003 | 53418 | 41.1134 | 0.9243 | 0.8257 | | 0.0156 | 306.0003 | 53592 | 54.7480 | 0.9219 | 0.8220 | | 0.0141 | 307.0003 | 53766 | 45.3864 | 0.9232 | 0.8232 | | 0.0153 | 308.0003 | 53940 | 55.6550 | 0.9252 | 0.8226 | | 0.0146 | 309.0003 | 54114 | 44.0080 | 0.9239 | 0.8159 | | 0.017 | 310.0003 | 54288 | 47.5062 | 0.9243 | 0.8180 | | 0.0147 | 311.0003 | 54462 | 42.0377 | 0.9200 | 0.8151 | | 0.0125 | 312.0003 | 54636 | 48.5603 | 0.9208 | 0.8191 | | 0.0145 | 313.0003 | 54810 | 48.6241 | 0.9169 | 0.8200 | | 0.0132 | 314.0003 | 54984 | 43.8088 | 0.9234 | 0.8220 | | 0.0141 | 315.0002 | 55158 | 51.1271 | 0.9204 | 0.8160 | | 0.0143 | 316.0002 | 55332 | 58.2586 | 0.9189 | 0.8125 | | 0.0159 | 317.0002 | 55506 | 42.7503 | 0.9215 | 0.8225 | | 0.0129 | 318.0002 | 55680 | 47.3913 | 0.9246 | 0.8242 | | 0.0123 | 319.0002 | 55854 | 58.5768 | 0.9213 | 0.8190 | | 0.0126 | 320.0002 | 56028 | 48.3929 | 0.9238 | 0.8229 | | 0.0148 | 321.0002 | 56202 | 45.0571 | 0.9233 | 0.8151 | | 0.0117 | 322.0002 | 56376 | 56.9938 | 0.9212 | 0.8194 | | 0.0145 | 323.0002 | 56550 | 42.7542 | 0.9255 | 0.8249 | | 0.0135 | 324.0002 | 56724 | 52.6050 | 0.9200 | 0.8178 | | 0.0136 | 325.0002 | 56898 | 59.1619 | 0.9214 | 0.8224 | ### Framework versions - Transformers 4.46.0 - Pytorch 2.3.1+cu121 - Datasets 2.20.0 - Tokenizers 0.20.1