Instructions to use google/gemma-scope-2b-pt-transcoders with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- SAELens
How to use google/gemma-scope-2b-pt-transcoders with SAELens:
# pip install sae-lens from sae_lens import SAE sae, cfg_dict, sparsity = SAE.from_pretrained( release = "RELEASE_ID", # e.g., "gpt2-small-res-jb". See other options in https://github.com/jbloomAus/SAELens/blob/main/sae_lens/pretrained_saes.yaml sae_id = "SAE_ID", # e.g., "blocks.8.hook_resid_pre". Won't always be a hook point ) - Notebooks
- Google Colab
- Kaggle
Upload folder using huggingface_hub
Browse files
layer_25/width_16k/average_l0_110/params.npz
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:d98bfd874caa81bdb6f3041d89ed62abfc284ec4b5c30cde16b7b74a75134dce
|
| 3 |
+
size 302131416
|
layer_25/width_16k/average_l0_179/params.npz
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:d4c8ab1c1411a150c4b1356d8a1df067399d3b7f2cbc90b2334aa0e39eb3f7fd
|
| 3 |
+
size 302131416
|
layer_25/width_16k/average_l0_41/params.npz
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:4a06259dfe7968152c2bab30d36e1472f6fa9df94a1f68e8c7dd9753308135c8
|
| 3 |
+
size 302131416
|
layer_25/width_16k/average_l0_68/params.npz
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:dda72e641f4b45bcba9b30263d957cdc1210dc122357a16dc679a986ba1298dc
|
| 3 |
+
size 302131416
|