2026-04-16 05:23:56,226 INFO    MainThread:1376325 [wandb_setup.py:_flush():81] Current SDK version is 0.25.1
2026-04-16 05:23:56,226 INFO    MainThread:1376325 [wandb_setup.py:_flush():81] Configure stats pid to 1376325
2026-04-16 05:23:56,226 INFO    MainThread:1376325 [wandb_setup.py:_flush():81] Loading settings from environment variables
2026-04-16 05:23:56,226 INFO    MainThread:1376325 [wandb_init.py:setup_run_log_directory():717] Logging user logs to /home/sunhc/diffusion/sad/wandb/run-20260416_052356-ij1n3ssi/logs/debug.log
2026-04-16 05:23:56,226 INFO    MainThread:1376325 [wandb_init.py:setup_run_log_directory():718] Logging internal logs to /home/sunhc/diffusion/sad/wandb/run-20260416_052356-ij1n3ssi/logs/debug-internal.log
2026-04-16 05:23:56,226 INFO    MainThread:1376325 [wandb_init.py:init():844] calling init triggers
2026-04-16 05:23:56,227 INFO    MainThread:1376325 [wandb_init.py:init():849] wandb.init called with sweep_config: {}
config: {'model': {'vocab_size': 50258, 'hidden_size': 768, 'n_blocks': 12, 'n_heads': 12, 'cond_dim': 128, 'max_seq_len': 512, 'block_size': 8, 'dropout': 0.0, 'num_levels': 4, 'level_sizes': [50258, 512, 64, 8], 'ancestor_temp': 1.0}, 'hierarchy': {'type': 'soft', 'temp_init': 1.0, 'learn_temp': True, 'init_kmeans': True, 'hierarchy_warmup_steps': 2000, 'prototype_cache': 'data/hierarchy_prototypes_50258-512-64-8.pt', 'top_k_per_level': [3, 2, 1]}, 'loss': {'lambda_sharp': 0.01, 'mask_only': False, 'reg_balance_weight': 0.01, 'reg_entropy_weight': 0.0}, 'training': {'seed': 0, 'batch_size': 64, 'num_steps': 2000, 'lr': 0.0003, 'lr_min': 3e-05, 'weight_decay': 0.01, 'grad_clip': 1.0, 'dtype': 'bf16', 'warmup_steps': 2000, 'log_interval': 100, 'eval_interval': 5000, 'save_interval': 10000, 'hierarchy_warmup_steps': 2000}, 'data': {'dataset': 'openwebtext', 'seq_len': 512, 'cache_dir': 'data/owt_cache', 'num_workers': 4, 'max_train_samples': None, 'max_val_samples': 100000}, 'logging': {'use_wandb': True, 'project': 'sad_new_owt', 'save_dir': 'outputs/sad_new'}, '_wandb': {}}
2026-04-16 05:23:56,227 INFO    MainThread:1376325 [wandb_init.py:init():892] starting backend
2026-04-16 05:23:56,452 INFO    MainThread:1376325 [wandb_init.py:init():895] sending inform_init request
2026-04-16 05:23:56,457 INFO    MainThread:1376325 [wandb_init.py:init():903] backend started and connected
2026-04-16 05:23:56,458 INFO    MainThread:1376325 [wandb_init.py:init():973] updated telemetry
2026-04-16 05:23:56,461 INFO    MainThread:1376325 [wandb_init.py:init():997] communicating run to backend with 90.0 second timeout
2026-04-16 05:23:57,774 INFO    MainThread:1376325 [wandb_init.py:init():1042] starting run threads in backend
2026-04-16 05:23:57,871 INFO    MainThread:1376325 [wandb_run.py:_console_start():2524] atexit reg
2026-04-16 05:23:57,871 INFO    MainThread:1376325 [wandb_run.py:_redirect():2373] redirect: wrap_raw
2026-04-16 05:23:57,871 INFO    MainThread:1376325 [wandb_run.py:_redirect():2442] Wrapping output streams.
2026-04-16 05:23:57,872 INFO    MainThread:1376325 [wandb_run.py:_redirect():2465] Redirects installed.
2026-04-16 05:23:57,876 INFO    MainThread:1376325 [wandb_init.py:init():1082] run started, returning control to user process
2026-04-16 05:35:25,951 INFO    wandb-AsyncioManager-main:1376325 [service_client.py:_forward_responses():134] Reached EOF.
2026-04-16 05:35:25,952 INFO    wandb-AsyncioManager-main:1376325 [mailbox.py:close():155] Closing mailbox, abandoning 1 handles.