Feature Extraction
Transformers
Safetensors
deberta-v2
chemistry
bioinformatics
drug-discovery
text-embeddings-inference
Instructions to use SaeedLab/MolDeBERTa-small-123M-contrastive_mtr with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use SaeedLab/MolDeBERTa-small-123M-contrastive_mtr with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("feature-extraction", model="SaeedLab/MolDeBERTa-small-123M-contrastive_mtr")# Load model directly from transformers import AutoTokenizer, AutoModel tokenizer = AutoTokenizer.from_pretrained("SaeedLab/MolDeBERTa-small-123M-contrastive_mtr") model = AutoModel.from_pretrained("SaeedLab/MolDeBERTa-small-123M-contrastive_mtr", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Update README.md
Browse files
README.md
CHANGED
|
@@ -14,7 +14,7 @@ tags:
|
|
| 14 |
|
| 15 |
This model corresponds to the MolDeBERTa small architecture pretrained on the 123M dataset using the contrastive MTR pretraining objective.
|
| 16 |
|
| 17 |
-
\[[Github Repo](https://github.com/pcdslab/MolDeBERTa)\] | \[[Dataset on HuggingFace](https://huggingface.co/datasets/SaeedLab/MolDeBERTa)\] | \[[Model Collection](https://huggingface.co/collections/SaeedLab/moldeberta)\] | \[[Cite](#citation)\]
|
| 18 |
|
| 19 |
## Abstract
|
| 20 |
|
|
@@ -64,7 +64,18 @@ print(embeddings.shape)
|
|
| 64 |
|
| 65 |
## Citation
|
| 66 |
|
| 67 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 68 |
|
| 69 |
## License
|
| 70 |
|
|
|
|
| 14 |
|
| 15 |
This model corresponds to the MolDeBERTa small architecture pretrained on the 123M dataset using the contrastive MTR pretraining objective.
|
| 16 |
|
| 17 |
+
\[[Paper](https://www.biorxiv.org/content/10.64898/2026.02.15.706011v2)\] | \[[Github Repo](https://github.com/pcdslab/MolDeBERTa)\] | \[[Dataset on HuggingFace](https://huggingface.co/datasets/SaeedLab/MolDeBERTa)\] | \[[Model Collection](https://huggingface.co/collections/SaeedLab/moldeberta)\] | \[[Cite](#citation)\]
|
| 18 |
|
| 19 |
## Abstract
|
| 20 |
|
|
|
|
| 64 |
|
| 65 |
## Citation
|
| 66 |
|
| 67 |
+
If you use MolDeBERTa in your research, please cite:
|
| 68 |
+
|
| 69 |
+
```bibtex
|
| 70 |
+
@article{moldeberta2026,
|
| 71 |
+
title = {MolDeBERTa: Foundational Model for Physicochemical and Substructure-Informed Molecular Representation Learning},
|
| 72 |
+
author = {Oliveira, Gabriel Bianchin de and Saeed, Fahad},
|
| 73 |
+
journal = {bioRxiv},
|
| 74 |
+
year = {2026},
|
| 75 |
+
doi = {10.64898/2026.02.15.706011},
|
| 76 |
+
url = {https://doi.org/10.64898/2026.02.15.706011}
|
| 77 |
+
}
|
| 78 |
+
```
|
| 79 |
|
| 80 |
## License
|
| 81 |
|