arpandeepk's picture
upload rmu_Llama-3.1-8B_20260427_203908
77e8fad verified
Raw
History Blame Contribute Delete
992 Bytes
2026-04-27 20:39:32,701 INFO cleanslate.fsid.training.trainer: [RANK 0] FSID train: model=meta-llama/Llama-3.1-8B objective=rmu run_dir=/runs/rmu_Llama-3.1-8B_20260427_203908
2026-04-27 20:39:32,703 INFO cleanslate.fsid.training.trainer: [RANK 0] Creating frozen reference model for rmu (dtype=torch.bfloat16)
2026-04-27 20:39:37,857 INFO cleanslate.fsid.training.trainer: [RANK 0] Starting training: objective=rmu epochs=2
2026-04-27 20:39:38,020 INFO cleanslate.fsid.training.trainer: [RANK 0] RMU control_vec init: dim=4096 seed=0 rank=0 world_size=1 per_rank_norm=2.000000
2026-04-27 20:50:17,489 INFO cleanslate.fsid.training.trainer: [RANK 0] Saved checkpoint to /runs/rmu_Llama-3.1-8B_20260427_203908
2026-04-27 20:50:17,498 INFO cleanslate.fsid.training.trainer: [RANK 0] Training complete (586.7s)
2026-04-27 20:50:17,901 INFO cleanslate.fsid.training.trainer: [RANK 0] Pushing checkpoint dir /runs/rmu_Llama-3.1-8B_20260427_203908 to unlearning-cleanslate/llama-3_1-8b-rmu-baseline