--- library_name: transformers tags: - generated_from_trainer metrics: - accuracy model-index: - name: ht-finbert-cls-v5_ftis_noPretrain results: [] --- # ht-finbert-cls-v5_ftis_noPretrain This model is a fine-tuned version of [](https://huggingface.co/) on an unknown dataset. It achieves the following results on the evaluation set: - Loss: 81.1363 - Accuracy: 0.9042 - Macro F1: 0.7667 ## Model description More information needed ## Intended uses & limitations More information needed ## Training and evaluation data More information needed ## Training procedure ### Training hyperparameters The following hyperparameters were used during training: - learning_rate: 0.0001 - train_batch_size: 8 - eval_batch_size: 4 - seed: 42 - optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments - lr_scheduler_type: linear - lr_scheduler_warmup_steps: 6725 - training_steps: 134500 ### Training results | Training Loss | Epoch | Step | Validation Loss | Accuracy | Macro F1 | |:-------------:|:--------:|:-----:|:---------------:|:--------:|:--------:| | 45.0676 | 1.0002 | 100 | 31.1821 | 0.1285 | 0.0406 | | 19.4006 | 2.0005 | 200 | 68.1208 | 0.2019 | 0.0529 | | 8.2771 | 4.0002 | 300 | 136.9383 | 0.4411 | 0.1231 | | 6.762 | 5.0004 | 400 | 173.8833 | 0.5386 | 0.1539 | | 6.248 | 7.0002 | 500 | 196.1728 | 0.5787 | 0.1747 | | 5.4753 | 8.0004 | 600 | 174.4677 | 0.5994 | 0.1929 | | 5.0104 | 10.0001 | 700 | 179.9477 | 0.6251 | 0.2109 | | 4.3823 | 11.0004 | 800 | 165.2404 | 0.6412 | 0.2228 | | 3.8137 | 13.0001 | 900 | 126.2967 | 0.6494 | 0.2399 | | 3.037 | 14.0004 | 1000 | 92.4416 | 0.6709 | 0.2487 | | 2.6226 | 16.0001 | 1100 | 66.3495 | 0.6960 | 0.2739 | | 2.2975 | 17.0003 | 1200 | 43.5563 | 0.6968 | 0.2943 | | 1.886 | 19.0001 | 1300 | 32.4852 | 0.7135 | 0.3308 | | 1.7708 | 20.0003 | 1400 | 25.2063 | 0.7362 | 0.3485 | | 1.5428 | 22.0000 | 1500 | 14.5124 | 0.7586 | 0.3908 | | 1.3687 | 23.0003 | 1600 | 12.6483 | 0.7656 | 0.3988 | | 1.2077 | 24.0005 | 1700 | 9.9227 | 0.7728 | 0.4407 | | 1.0739 | 26.0002 | 1800 | 6.5034 | 0.7769 | 0.4490 | | 1.0011 | 27.0005 | 1900 | 4.9661 | 0.7945 | 0.4831 | | 0.9156 | 29.0002 | 2000 | 4.2065 | 0.7991 | 0.4963 | | 0.8269 | 30.0004 | 2100 | 4.6309 | 0.7983 | 0.4969 | | 0.7589 | 32.0002 | 2200 | 4.1331 | 0.8012 | 0.5166 | | 0.7167 | 33.0004 | 2300 | 3.5127 | 0.7973 | 0.5446 | | 0.7028 | 35.0001 | 2400 | 3.5852 | 0.8079 | 0.5536 | | 0.585 | 36.0004 | 2500 | 3.2344 | 0.8126 | 0.5567 | | 0.5776 | 38.0001 | 2600 | 3.5203 | 0.8167 | 0.5712 | | 0.4885 | 39.0004 | 2700 | 3.5398 | 0.8195 | 0.5749 | | 0.4628 | 41.0001 | 2800 | 2.6125 | 0.8228 | 0.5911 | | 0.4469 | 42.0003 | 2900 | 3.1494 | 0.8270 | 0.5864 | | 0.4206 | 44.0001 | 3000 | 3.1127 | 0.8363 | 0.5987 | | 0.3589 | 45.0003 | 3100 | 3.2779 | 0.8355 | 0.6062 | | 0.3559 | 47.0000 | 3200 | 4.2942 | 0.8408 | 0.6111 | | 0.3242 | 48.0003 | 3300 | 4.0195 | 0.8426 | 0.6144 | | 0.283 | 49.0005 | 3400 | 3.8392 | 0.8380 | 0.6227 | | 0.2741 | 51.0002 | 3500 | 4.2446 | 0.8444 | 0.6320 | | 0.2605 | 52.0005 | 3600 | 4.8914 | 0.8453 | 0.6366 | | 0.2494 | 54.0002 | 3700 | 4.8815 | 0.8493 | 0.6371 | | 0.2232 | 55.0004 | 3800 | 4.7650 | 0.8416 | 0.6303 | | 0.2166 | 57.0002 | 3900 | 6.3975 | 0.8517 | 0.6382 | | 0.2011 | 58.0004 | 4000 | 7.1631 | 0.8559 | 0.6499 | | 0.1959 | 60.0001 | 4100 | 7.4066 | 0.8528 | 0.6502 | | 0.1646 | 61.0004 | 4200 | 8.2311 | 0.8585 | 0.6517 | | 0.1564 | 63.0001 | 4300 | 7.1946 | 0.8561 | 0.6599 | | 0.1534 | 64.0004 | 4400 | 9.1525 | 0.8581 | 0.6502 | | 0.1352 | 66.0001 | 4500 | 10.3164 | 0.8542 | 0.6484 | | 0.1329 | 67.0003 | 4600 | 9.9375 | 0.8616 | 0.6693 | | 0.1305 | 69.0001 | 4700 | 10.1664 | 0.8615 | 0.6597 | | 0.1174 | 70.0003 | 4800 | 11.4316 | 0.8658 | 0.6699 | | 0.1112 | 72.0000 | 4900 | 12.6254 | 0.8584 | 0.6618 | | 0.1092 | 73.0003 | 5000 | 12.6325 | 0.8598 | 0.6639 | | 0.0995 | 74.0005 | 5100 | 13.3681 | 0.8646 | 0.6745 | | 0.0961 | 76.0002 | 5200 | 15.6989 | 0.8655 | 0.6756 | | 0.0924 | 77.0005 | 5300 | 13.0087 | 0.8686 | 0.6830 | | 0.0862 | 79.0002 | 5400 | 15.9182 | 0.8578 | 0.6560 | | 0.0817 | 80.0004 | 5500 | 14.4908 | 0.8691 | 0.6783 | | 0.0842 | 82.0002 | 5600 | 14.6304 | 0.8724 | 0.6830 | | 0.0741 | 83.0004 | 5700 | 14.6875 | 0.8729 | 0.6846 | | 0.0744 | 85.0001 | 5800 | 14.5500 | 0.8703 | 0.6881 | | 0.0761 | 86.0004 | 5900 | 17.4833 | 0.8714 | 0.6910 | | 0.0666 | 88.0001 | 6000 | 19.3463 | 0.8714 | 0.6929 | | 0.0699 | 89.0004 | 6100 | 19.4385 | 0.8697 | 0.6820 | | 0.0584 | 91.0001 | 6200 | 14.6828 | 0.8751 | 0.6990 | | 0.0571 | 92.0003 | 6300 | 19.9995 | 0.8730 | 0.7022 | | 0.0465 | 94.0001 | 6400 | 17.5651 | 0.8728 | 0.6946 | | 0.0575 | 95.0003 | 6500 | 17.5305 | 0.8746 | 0.6949 | | 0.0578 | 97.0000 | 6600 | 16.4489 | 0.8712 | 0.6927 | | 0.0518 | 98.0003 | 6700 | 14.3277 | 0.8714 | 0.6986 | | 0.0545 | 99.0005 | 6800 | 15.3278 | 0.8781 | 0.7030 | | 0.0435 | 101.0002 | 6900 | 14.6482 | 0.8793 | 0.7060 | | 0.0476 | 102.0005 | 7000 | 14.2258 | 0.8766 | 0.7067 | | 0.0441 | 104.0002 | 7100 | 15.6941 | 0.8762 | 0.7055 | | 0.0438 | 105.0004 | 7200 | 15.5653 | 0.8813 | 0.7052 | | 0.0369 | 107.0002 | 7300 | 18.7607 | 0.8823 | 0.7102 | | 0.0331 | 108.0004 | 7400 | 14.4900 | 0.8803 | 0.7061 | | 0.0318 | 110.0001 | 7500 | 15.7354 | 0.8828 | 0.7156 | | 0.044 | 111.0004 | 7600 | 11.1731 | 0.8755 | 0.7076 | | 0.0597 | 113.0001 | 7700 | 10.0075 | 0.8695 | 0.6968 | | 0.0491 | 114.0004 | 7800 | 9.4998 | 0.8786 | 0.7092 | | 0.0351 | 116.0001 | 7900 | 12.6520 | 0.8831 | 0.7201 | | 0.0341 | 117.0003 | 8000 | 12.2682 | 0.8848 | 0.7161 | | 0.0249 | 119.0001 | 8100 | 17.8114 | 0.8880 | 0.7252 | | 0.0268 | 120.0003 | 8200 | 15.4698 | 0.8869 | 0.7203 | | 0.0232 | 122.0000 | 8300 | 13.2290 | 0.8848 | 0.7243 | | 0.0329 | 123.0003 | 8400 | 11.1420 | 0.8820 | 0.7139 | | 0.0334 | 124.0005 | 8500 | 10.7191 | 0.8831 | 0.7170 | | 0.0259 | 126.0002 | 8600 | 11.7934 | 0.8840 | 0.7176 | | 0.0259 | 127.0005 | 8700 | 10.6811 | 0.8817 | 0.7187 | | 0.021 | 129.0002 | 8800 | 10.5715 | 0.8852 | 0.7208 | | 0.0263 | 130.0004 | 8900 | 11.4068 | 0.8836 | 0.7243 | | 0.036 | 132.0002 | 9000 | 9.0095 | 0.8797 | 0.7145 | | 0.0361 | 133.0004 | 9100 | 8.9163 | 0.8773 | 0.7046 | | 0.0216 | 135.0001 | 9200 | 11.9302 | 0.8883 | 0.7236 | | 0.0237 | 136.0004 | 9300 | 11.7925 | 0.8855 | 0.7231 | | 0.0211 | 138.0001 | 9400 | 10.9545 | 0.8856 | 0.7193 | | 0.0153 | 139.0004 | 9500 | 13.9894 | 0.8894 | 0.7286 | | 0.0115 | 141.0001 | 9600 | 14.7466 | 0.8903 | 0.7290 | | 0.0122 | 142.0003 | 9700 | 12.1514 | 0.8904 | 0.7301 | | 0.0101 | 144.0001 | 9800 | 10.6813 | 0.8901 | 0.7271 | | 0.0112 | 145.0003 | 9900 | 11.4336 | 0.8905 | 0.7299 | | 0.0122 | 147.0000 | 10000 | 12.2161 | 0.8862 | 0.7135 | | 0.0127 | 148.0003 | 10100 | 9.7058 | 0.8843 | 0.7183 | | 0.0545 | 149.0005 | 10200 | 6.6516 | 0.8737 | 0.6888 | | 0.0674 | 151.0002 | 10300 | 3.3112 | 0.8793 | 0.7046 | | 0.0534 | 152.0005 | 10400 | 3.5717 | 0.8753 | 0.7071 | | 0.0298 | 154.0002 | 10500 | 7.0293 | 0.8833 | 0.7214 | | 0.0256 | 155.0004 | 10600 | 7.5055 | 0.8836 | 0.7207 | | 0.0197 | 157.0002 | 10700 | 13.0153 | 0.8876 | 0.7299 | | 0.0159 | 158.0004 | 10800 | 17.7438 | 0.8917 | 0.7356 | | 0.012 | 160.0001 | 10900 | 17.8027 | 0.8932 | 0.7364 | | 0.0134 | 161.0004 | 11000 | 12.3195 | 0.8934 | 0.7351 | | 0.0121 | 163.0001 | 11100 | 14.9650 | 0.8936 | 0.7339 | | 0.0126 | 164.0004 | 11200 | 8.8533 | 0.8924 | 0.7366 | | 0.01 | 166.0001 | 11300 | 8.4018 | 0.8937 | 0.7341 | | 0.0158 | 167.0003 | 11400 | 9.3958 | 0.8923 | 0.7320 | | 0.0102 | 169.0001 | 11500 | 13.7997 | 0.8920 | 0.7344 | | 0.0081 | 170.0003 | 11600 | 11.3117 | 0.8936 | 0.7370 | | 0.009 | 172.0000 | 11700 | 11.9036 | 0.8933 | 0.7308 | | 0.008 | 173.0003 | 11800 | 15.0448 | 0.8923 | 0.7339 | | 0.0076 | 174.0005 | 11900 | 14.3777 | 0.8946 | 0.7384 | | 0.0071 | 176.0002 | 12000 | 15.5394 | 0.8933 | 0.7304 | | 0.0175 | 177.0005 | 12100 | 7.1299 | 0.8817 | 0.7064 | | 0.0349 | 179.0002 | 12200 | 4.0062 | 0.8765 | 0.7060 | | 0.0458 | 180.0004 | 12300 | 3.8608 | 0.8831 | 0.7230 | | 0.0311 | 182.0002 | 12400 | 4.3278 | 0.8899 | 0.7359 | | 0.016 | 183.0004 | 12500 | 10.5550 | 0.8893 | 0.7375 | | 0.0169 | 185.0001 | 12600 | 11.4108 | 0.8862 | 0.7262 | | 0.0204 | 186.0004 | 12700 | 6.5110 | 0.8893 | 0.7360 | | 0.0144 | 188.0001 | 12800 | 5.6207 | 0.8878 | 0.7364 | | 0.0236 | 189.0004 | 12900 | 9.0571 | 0.8879 | 0.7396 | | 0.0281 | 191.0001 | 13000 | 7.3068 | 0.8754 | 0.7239 | | 0.0141 | 192.0003 | 13100 | 9.6482 | 0.8872 | 0.7284 | | 0.0138 | 194.0001 | 13200 | 6.9724 | 0.8886 | 0.7398 | | 0.0787 | 195.0003 | 13300 | 4.5048 | 0.8831 | 0.7316 | | 0.0109 | 197.0000 | 13400 | 9.6796 | 0.8928 | 0.7392 | | 0.0052 | 198.0003 | 13500 | 8.9247 | 0.8951 | 0.7425 | | 0.0048 | 199.0005 | 13600 | 15.2835 | 0.8956 | 0.7431 | | 0.0041 | 201.0002 | 13700 | 16.9510 | 0.8961 | 0.7432 | | 0.0043 | 202.0005 | 13800 | 16.5854 | 0.8958 | 0.7445 | | 0.0034 | 204.0002 | 13900 | 18.8011 | 0.8951 | 0.7429 | | 0.0031 | 205.0004 | 14000 | 20.6246 | 0.8957 | 0.7444 | | 0.0038 | 207.0002 | 14100 | 17.3915 | 0.8958 | 0.7428 | | 0.0027 | 208.0004 | 14200 | 16.5060 | 0.8950 | 0.7435 | | 0.0028 | 210.0001 | 14300 | 20.6538 | 0.8948 | 0.7440 | | 0.0042 | 211.0004 | 14400 | 15.1694 | 0.8945 | 0.7441 | | 0.0048 | 213.0001 | 14500 | 15.7892 | 0.8936 | 0.7421 | | 0.0053 | 214.0004 | 14600 | 12.2524 | 0.8919 | 0.7408 | | 0.0071 | 216.0001 | 14700 | 13.9876 | 0.8943 | 0.7406 | | 0.0184 | 217.0003 | 14800 | 7.4169 | 0.8866 | 0.7354 | | 0.0918 | 219.0001 | 14900 | 8.8100 | 0.8753 | 0.7143 | | 0.0306 | 220.0003 | 15000 | 3.3898 | 0.8879 | 0.7307 | | 0.0137 | 222.0000 | 15100 | 4.9263 | 0.8917 | 0.7329 | | 0.0064 | 223.0003 | 15200 | 14.2685 | 0.8970 | 0.7473 | | 0.0094 | 224.0005 | 15300 | 8.1640 | 0.8930 | 0.7469 | | 0.0053 | 226.0002 | 15400 | 11.3225 | 0.8976 | 0.7473 | | 0.0033 | 227.0005 | 15500 | 19.1844 | 0.8976 | 0.7508 | | 0.0032 | 229.0002 | 15600 | 20.4924 | 0.8975 | 0.7502 | | 0.0121 | 230.0004 | 15700 | 11.6179 | 0.8882 | 0.7434 | | 0.0118 | 232.0002 | 15800 | 21.6421 | 0.8824 | 0.7419 | | 0.0284 | 233.0004 | 15900 | 4.5728 | 0.8889 | 0.7386 | | 0.0195 | 235.0001 | 16000 | 4.8290 | 0.8826 | 0.7251 | | 0.0113 | 236.0004 | 16100 | 14.2772 | 0.8916 | 0.7398 | | 0.0054 | 238.0001 | 16200 | 20.3585 | 0.8961 | 0.7481 | | 0.0028 | 239.0004 | 16300 | 20.2379 | 0.8975 | 0.7499 | | 0.0043 | 241.0001 | 16400 | 19.4160 | 0.8967 | 0.7495 | | 0.003 | 242.0003 | 16500 | 20.7979 | 0.8971 | 0.7527 | | 0.0035 | 244.0001 | 16600 | 29.2321 | 0.8956 | 0.7475 | | 0.0024 | 245.0003 | 16700 | 47.2586 | 0.8962 | 0.7503 | | 0.0023 | 247.0000 | 16800 | 29.1709 | 0.8969 | 0.7502 | | 0.0025 | 248.0003 | 16900 | 37.5283 | 0.8966 | 0.7478 | | 0.0044 | 249.0005 | 17000 | 41.7058 | 0.8961 | 0.7496 | | 0.0026 | 251.0002 | 17100 | 31.6237 | 0.8963 | 0.7474 | | 0.0023 | 252.0005 | 17200 | 41.6650 | 0.8965 | 0.7486 | | 0.0027 | 254.0002 | 17300 | 43.0484 | 0.8966 | 0.7498 | | 0.0049 | 255.0004 | 17400 | 37.0223 | 0.8956 | 0.7481 | | 0.0303 | 257.0002 | 17500 | 24.6823 | 0.8921 | 0.7385 | | 0.0387 | 258.0004 | 17600 | 17.9779 | 0.8905 | 0.7310 | | 0.0112 | 260.0001 | 17700 | 18.8216 | 0.8947 | 0.7463 | | 0.0058 | 261.0004 | 17800 | 23.2339 | 0.8945 | 0.7462 | | 0.0043 | 263.0001 | 17900 | 34.1779 | 0.8980 | 0.7527 | | 0.0177 | 264.0004 | 18000 | 24.5262 | 0.8966 | 0.7449 | | 0.0235 | 266.0001 | 18100 | 25.9108 | 0.8941 | 0.7427 | | 0.0093 | 267.0003 | 18200 | 14.0127 | 0.8964 | 0.7514 | | 0.0104 | 269.0001 | 18300 | 29.3661 | 0.8962 | 0.7498 | | 0.0051 | 270.0003 | 18400 | 26.7586 | 0.8992 | 0.7530 | | 0.0023 | 272.0000 | 18500 | 41.9991 | 0.8992 | 0.7560 | | 0.0043 | 273.0003 | 18600 | 42.3595 | 0.8991 | 0.7522 | | 0.0038 | 274.0005 | 18700 | 42.9884 | 0.8989 | 0.7509 | | 0.0017 | 276.0002 | 18800 | 37.0404 | 0.8994 | 0.7532 | | 0.0016 | 277.0005 | 18900 | 42.3473 | 0.8990 | 0.7519 | | 0.0013 | 279.0002 | 19000 | 57.6952 | 0.8998 | 0.7543 | | 0.0013 | 280.0004 | 19100 | 60.3771 | 0.8990 | 0.7541 | | 0.0012 | 282.0002 | 19200 | 53.2421 | 0.8997 | 0.7529 | | 0.0014 | 283.0004 | 19300 | 64.6741 | 0.8993 | 0.7524 | | 0.0012 | 285.0001 | 19400 | 48.5421 | 0.8991 | 0.7533 | | 0.0027 | 286.0004 | 19500 | 34.8083 | 0.8984 | 0.7544 | | 0.0156 | 288.0001 | 19600 | 35.5514 | 0.8866 | 0.7324 | | 0.0226 | 289.0004 | 19700 | 24.4246 | 0.8909 | 0.7414 | | 0.0191 | 291.0001 | 19800 | 19.4421 | 0.8933 | 0.7449 | | 0.0393 | 292.0003 | 19900 | 7.0450 | 0.8883 | 0.7401 | | 0.0083 | 294.0001 | 20000 | 12.4825 | 0.8922 | 0.7470 | | 0.0074 | 295.0003 | 20100 | 11.9688 | 0.8871 | 0.7420 | | 0.0046 | 297.0000 | 20200 | 19.6892 | 0.8995 | 0.7578 | | 0.0022 | 298.0003 | 20300 | 30.8790 | 0.8989 | 0.7575 | | 0.0019 | 299.0005 | 20400 | 33.0787 | 0.8992 | 0.7577 | | 0.0013 | 301.0002 | 20500 | 34.6523 | 0.8993 | 0.7582 | | 0.0016 | 302.0005 | 20600 | 39.9316 | 0.8994 | 0.7586 | | 0.0013 | 304.0002 | 20700 | 51.9175 | 0.8998 | 0.7580 | | 0.0011 | 305.0004 | 20800 | 43.7849 | 0.9000 | 0.7599 | | 0.001 | 307.0002 | 20900 | 48.0775 | 0.9002 | 0.7580 | | 0.0009 | 308.0004 | 21000 | 65.2401 | 0.8990 | 0.7558 | | 0.0012 | 310.0001 | 21100 | 49.7671 | 0.8992 | 0.7567 | | 0.001 | 311.0004 | 21200 | 70.8881 | 0.8986 | 0.7564 | | 0.0011 | 313.0001 | 21300 | 67.3829 | 0.8983 | 0.7535 | | 0.003 | 314.0004 | 21400 | 68.4742 | 0.8947 | 0.7462 | | 0.0178 | 316.0001 | 21500 | 24.7675 | 0.8905 | 0.7439 | | 0.0171 | 317.0003 | 21600 | 9.9862 | 0.8950 | 0.7481 | | 0.0262 | 319.0001 | 21700 | 13.0878 | 0.8959 | 0.7486 | | 0.0062 | 320.0003 | 21800 | 16.1960 | 0.8988 | 0.7572 | | 0.0038 | 322.0000 | 21900 | 27.5440 | 0.9014 | 0.7581 | | 0.0017 | 323.0003 | 22000 | 31.9094 | 0.9022 | 0.7595 | | 0.0018 | 324.0005 | 22100 | 48.4740 | 0.9018 | 0.7601 | | 0.0017 | 326.0002 | 22200 | 51.1269 | 0.9019 | 0.7593 | | 0.0012 | 327.0005 | 22300 | 35.8104 | 0.9025 | 0.7598 | | 0.0012 | 329.0002 | 22400 | 46.4160 | 0.9009 | 0.7579 | | 0.0011 | 330.0004 | 22500 | 36.0973 | 0.9021 | 0.7573 | | 0.001 | 332.0002 | 22600 | 44.6799 | 0.9031 | 0.7584 | | 0.001 | 333.0004 | 22700 | 55.4978 | 0.9012 | 0.7580 | | 0.0009 | 335.0001 | 22800 | 61.3688 | 0.9016 | 0.7581 | | 0.0009 | 336.0004 | 22900 | 71.0979 | 0.9004 | 0.7588 | | 0.0009 | 338.0001 | 23000 | 62.9048 | 0.9012 | 0.7578 | | 0.0014 | 339.0004 | 23100 | 50.8666 | 0.9014 | 0.7579 | | 0.0012 | 341.0001 | 23200 | 65.1823 | 0.9003 | 0.7585 | | 0.0034 | 342.0003 | 23300 | 30.2251 | 0.8937 | 0.7550 | | 0.0174 | 344.0001 | 23400 | 13.0308 | 0.8939 | 0.7481 | | 0.0182 | 345.0003 | 23500 | 5.2059 | 0.8907 | 0.7454 | | 0.013 | 347.0000 | 23600 | 11.5163 | 0.8986 | 0.7514 | | 0.0292 | 348.0003 | 23700 | 13.9127 | 0.8976 | 0.7566 | | 0.0137 | 349.0005 | 23800 | 10.6804 | 0.8984 | 0.7545 | | 0.0069 | 351.0002 | 23900 | 11.2971 | 0.8998 | 0.7575 | | 0.0033 | 352.0005 | 24000 | 21.1634 | 0.8986 | 0.7567 | | 0.0018 | 354.0002 | 24100 | 19.6101 | 0.9016 | 0.7620 | | 0.0011 | 355.0004 | 24200 | 20.5261 | 0.9015 | 0.7632 | | 0.0009 | 357.0002 | 24300 | 29.3978 | 0.9007 | 0.7612 | | 0.0009 | 358.0004 | 24400 | 51.2728 | 0.9010 | 0.7625 | | 0.0008 | 360.0001 | 24500 | 50.0836 | 0.9019 | 0.7640 | | 0.0007 | 361.0004 | 24600 | 60.3942 | 0.9018 | 0.7631 | | 0.0008 | 363.0001 | 24700 | 40.0778 | 0.9011 | 0.7613 | | 0.0007 | 364.0004 | 24800 | 53.6138 | 0.9017 | 0.7635 | | 0.0007 | 366.0001 | 24900 | 62.7782 | 0.9013 | 0.7621 | | 0.001 | 367.0003 | 25000 | 55.9975 | 0.9013 | 0.7616 | | 0.0019 | 369.0001 | 25100 | 42.9915 | 0.8990 | 0.7603 | | 0.0065 | 370.0003 | 25200 | 21.8315 | 0.8970 | 0.7562 | | 0.006 | 372.0000 | 25300 | 11.9061 | 0.8994 | 0.7603 | | 0.0048 | 373.0003 | 25400 | 45.9796 | 0.8994 | 0.7561 | | 0.0323 | 374.0005 | 25500 | 44.4078 | 0.8734 | 0.7361 | | 0.0134 | 376.0002 | 25600 | 14.2978 | 0.8891 | 0.7461 | | 0.0225 | 377.0005 | 25700 | 14.0887 | 0.8913 | 0.7470 | | 0.0231 | 379.0002 | 25800 | 11.5317 | 0.8969 | 0.7505 | | 0.0035 | 380.0004 | 25900 | 24.4447 | 0.9001 | 0.7559 | | 0.0017 | 382.0002 | 26000 | 40.8653 | 0.9028 | 0.7602 | | 0.0013 | 383.0004 | 26100 | 49.7169 | 0.9020 | 0.7628 | | 0.001 | 385.0001 | 26200 | 51.5715 | 0.9029 | 0.7628 | | 0.001 | 386.0004 | 26300 | 57.2407 | 0.9030 | 0.7627 | | 0.0008 | 388.0001 | 26400 | 70.8088 | 0.9025 | 0.7635 | | 0.0008 | 389.0004 | 26500 | 72.1200 | 0.9025 | 0.7644 | | 0.0007 | 391.0001 | 26600 | 75.3892 | 0.9025 | 0.7615 | | 0.0006 | 392.0003 | 26700 | 79.6278 | 0.9027 | 0.7621 | | 0.0008 | 394.0001 | 26800 | 92.8254 | 0.9020 | 0.7630 | | 0.0008 | 395.0003 | 26900 | 94.8828 | 0.9023 | 0.7630 | | 0.0009 | 397.0000 | 27000 | 102.5585 | 0.9021 | 0.7619 | | 0.0007 | 398.0003 | 27100 | 85.7570 | 0.9020 | 0.7643 | | 0.0006 | 399.0005 | 27200 | 89.4980 | 0.9025 | 0.7625 | | 0.0013 | 401.0002 | 27300 | 75.6506 | 0.9000 | 0.7586 | | 0.0008 | 402.0005 | 27400 | 80.6390 | 0.9016 | 0.7614 | | 0.0007 | 404.0002 | 27500 | 94.0275 | 0.9015 | 0.7646 | | 0.0007 | 405.0004 | 27600 | 95.5629 | 0.9009 | 0.7610 | | 0.0019 | 407.0002 | 27700 | 101.7122 | 0.9004 | 0.7558 | | 0.0138 | 408.0004 | 27800 | 78.1587 | 0.8963 | 0.7433 | | 0.0173 | 410.0001 | 27900 | 79.9526 | 0.8940 | 0.7440 | | 0.0172 | 411.0004 | 28000 | 99.2792 | 0.8948 | 0.7511 | | 0.0029 | 413.0001 | 28100 | 59.4914 | 0.8994 | 0.7579 | | 0.0046 | 414.0004 | 28200 | 57.0540 | 0.9008 | 0.7600 | | 0.0023 | 416.0001 | 28300 | 64.6390 | 0.8998 | 0.7602 | | 0.0145 | 417.0003 | 28400 | 82.8896 | 0.8920 | 0.7568 | | 0.0087 | 419.0001 | 28500 | 30.3067 | 0.8958 | 0.7557 | | 0.0029 | 420.0003 | 28600 | 35.0321 | 0.9007 | 0.7567 | | 0.0015 | 422.0000 | 28700 | 71.1409 | 0.9018 | 0.7604 | | 0.001 | 423.0003 | 28800 | 76.6434 | 0.9035 | 0.7636 | | 0.0013 | 424.0005 | 28900 | 80.0947 | 0.9042 | 0.7667 | | 0.0007 | 426.0002 | 29000 | 100.5315 | 0.9032 | 0.7635 | | 0.0007 | 427.0005 | 29100 | 112.5028 | 0.9041 | 0.7643 | | 0.0005 | 429.0002 | 29200 | 133.8390 | 0.9031 | 0.7637 | | 0.0007 | 430.0004 | 29300 | 107.5043 | 0.9032 | 0.7624 | | 0.0006 | 432.0002 | 29400 | 115.0514 | 0.9030 | 0.7629 | | 0.0005 | 433.0004 | 29500 | 114.5789 | 0.9022 | 0.7623 | | 0.0005 | 435.0001 | 29600 | 104.5168 | 0.9024 | 0.7623 | | 0.0006 | 436.0004 | 29700 | 80.4484 | 0.9043 | 0.7647 | | 0.0005 | 438.0001 | 29800 | 100.4194 | 0.9026 | 0.7631 | | 0.0005 | 439.0004 | 29900 | 95.6818 | 0.9026 | 0.7635 | | 0.0005 | 441.0001 | 30000 | 102.6654 | 0.9032 | 0.7610 | | 0.0014 | 442.0003 | 30100 | 91.4808 | 0.9034 | 0.7637 | | 0.0013 | 444.0001 | 30200 | 123.4039 | 0.9022 | 0.7608 | | 0.0007 | 445.0003 | 30300 | 126.6161 | 0.9024 | 0.7618 | | 0.0091 | 447.0000 | 30400 | 47.7548 | 0.8973 | 0.7519 | | 0.0237 | 448.0003 | 30500 | 30.0946 | 0.8936 | 0.7466 | | 0.014 | 449.0005 | 30600 | 25.0813 | 0.8961 | 0.7521 | | 0.01 | 451.0002 | 30700 | 27.5127 | 0.8990 | 0.7542 | | 0.0042 | 452.0005 | 30800 | 28.1089 | 0.9018 | 0.7629 | | 0.0014 | 454.0002 | 30900 | 60.5717 | 0.9007 | 0.7622 | ### Framework versions - Transformers 4.46.0 - Pytorch 2.3.1+cu121 - Datasets 2.20.0 - Tokenizers 0.20.1