| name,layers,parameters,weight_bytes,weight_mib,weight_sha256,kd_stage,mean_total_loss,mean_interface_loss,mean_final_loss |
| 24L upstream text teacher,24,752393024,1504825632,1435.1135559082031,30783da4651259c26b8a204821ea426b9526431e0c14da0d1c6fa284e7414e5e,,,, |
| 8L task-free KD,8,420318144,840647880,801.7042922973633,086fbaf9a4838ecde56cd3541c9c3212b22d0c5ee745cf2c1c5e0bb31e0ec22c,24to8,0.17622653172702485,0.21562811763578793,0.16626427527853593 |
| 6L task-free KD,6,377207424,754423424,719.4742431640625,492749c20f77a42f6bc993f0927a82217b94f872b7eacf25612f7520c9bc28ce,8to6,0.03382104352249371,0.04486069045515251,0.031147060785087888 |
| 4L task-free KD root,4,334096704,668198976,637.2442016601562,2732c616772fe320cdea228ab4554981418b1b2bf615c4183fb1ac8e6e2168d3,6to4,0.047020394468859195,0.07048421185527332,0.043119939065377366 |
|
|
