Solshine
/

gemma-4-e2b-scope-v1-L17-batchtopk-k64-seed17

sparse-autoencoder

mechanistic-interpretability

Model card Files Files and versions

Solshine commited on Apr 30

Commit

2540c58

·

verified ·

1 Parent(s): 10e4781

Checkpoint README: 14,003,200 tokens

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -9,6 +9,6 @@ tags: [sparse-autoencoder, mechanistic-interpretability, sae-lens, gemma-4, batc
 BatchTopK SAE, L17, d_sae=24576, k=64, expansion 16x.
 Training on FineWeb-Edu via Colab T4 bnb 4-bit inference.
-**Progress:** 12,002,304 / 100,000,000 tokens (12.0 %). Steps: 11,721.
 Live W&B: https://wandb.ai/caleb-deleeuw/gemma4-sae-scope/runs/gemma-4-e2b-scope-v1-L17-batchtopk-k64-seed17

 BatchTopK SAE, L17, d_sae=24576, k=64, expansion 16x.
 Training on FineWeb-Edu via Colab T4 bnb 4-bit inference.
+**Progress:** 14,003,200 / 100,000,000 tokens (14.0 %). Steps: 13,675.
 Live W&B: https://wandb.ai/caleb-deleeuw/gemma4-sae-scope/runs/gemma-4-e2b-scope-v1-L17-batchtopk-k64-seed17