step,tokens_seen,cumulative_flops,train_loss,eval_loss 1000,98304000,5.914170e+16,17.492647,16.091018 2000,196608000,1.182834e+17,7.579586,7.497744 3000,294912000,1.774251e+17,6.675391,6.686896 4000,393216000,2.365668e+17,6.245444,6.241085 5000,491520000,2.957085e+17,5.919053,5.882695 6000,589824000,3.548502e+17,5.602068,5.566419 7000,688128000,4.139919e+17,5.290547,5.228017 8000,786432000,4.731336e+17,5.027129,4.997530 9000,884736000,5.322753e+17,4.872146,4.825130 10000,983040000,5.914170e+17,4.758634,4.723539 11000,1081344000,6.505587e+17,4.663044,4.622023 12000,1179648000,7.097004e+17,4.585759,4.541563 13000,1277952000,7.688421e+17,4.526364,4.473602 14000,1376256000,8.279838e+17,4.482114,4.427103 15000,1474560000,8.871255e+17,4.428709,4.374792 16000,1572864000,9.462672e+17,4.393361,4.342701 17000,1671168000,1.005409e+18,4.356677,4.308100 18000,1769472000,1.064551e+18,4.321714,4.277403 19000,1867776000,1.123692e+18,4.309224,4.251713 20000,1966080000,1.182834e+18,4.284989,4.230857 21000,2064384000,1.241976e+18,4.258484,4.212549 22000,2162688000,1.301117e+18,4.247494,4.197306 23000,2260992000,1.360259e+18,4.238625,4.185701 24000,2359296000,1.419401e+18,4.224255,4.176146 25000,2457600000,1.478542e+18,4.204448,4.168173 25432,2500067328,1.504092e+18,4.204448,4.203846