Feature Extraction
Transformers
English
esmc_sae
biology
esm
protein
sparse-autoencoder
interpretability
protein-embeddings
protein-language-model
unsupervised-learning
Instructions to use biohub/ESMC-6B-sae-layer60-k128-codebook32768 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use biohub/ESMC-6B-sae-layer60-k128-codebook32768 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("feature-extraction", model="biohub/ESMC-6B-sae-layer60-k128-codebook32768")# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("biohub/ESMC-6B-sae-layer60-k128-codebook32768", dtype="auto") - Notebooks
- Google Colab
- Kaggle
| { | |
| "available_layers": [ | |
| 60 | |
| ], | |
| "codebook_dim": 32768, | |
| "d_model": 2560, | |
| "k": 128, | |
| "model_type": "esmc_sae", | |
| "transformers_version": "4.57.6" | |
| } | |