You need to agree to share your contact information to access this model

This repository is publicly accessible, but you have to accept the conditions to access its files and content.

sae-gemma-2-9b-it-topk-l21

A TopK sparse autoencoder for google/gemma-2-9b-it, residual-stream layer 21 (d_in=3584, d_sae=57344, k=64, FVU=0.4772). Trained with the v2 recipe (BOS-drop + per-dim standardization) for The Refusal Slope: A Mechanistic Taxonomy of Feature Fate in Quantized Edge Intelligence (M. Elrashid, BUiD).

from huggingface_hub import hf_hub_download
from sae import load_sae, encode_residual   # sae.py ships in this repo
sae, mu, sd, meta = load_sae(hf_hub_download("elrashid/sae-gemma-2-9b-it-topk-l21", "sae.pt"), device="cuda")

Downloads last month: -; Downloads are not tracked for this model. How to track

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for elrashid/sae-gemma-2-9b-it-topk-l21

Base model

google/gemma-2-9b

Finetuned

google/gemma-2-9b-it

Finetuned

(506)

this model