Text Classification
Transformers
Safetensors
PEFT
English
bert
medical-triage
biomedbert
frozen-encoder
healthcare
symptom-checker
natural-language-processing
academic-project
Eval Results (legacy)
text-embeddings-inference
Instructions to use cristian-untaru/frozen-encoder-biomedbert-medical-triage with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use cristian-untaru/frozen-encoder-biomedbert-medical-triage with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-classification", model="cristian-untaru/frozen-encoder-biomedbert-medical-triage")# Load model directly from transformers import AutoTokenizer, AutoModelForSequenceClassification tokenizer = AutoTokenizer.from_pretrained("cristian-untaru/frozen-encoder-biomedbert-medical-triage") model = AutoModelForSequenceClassification.from_pretrained("cristian-untaru/frozen-encoder-biomedbert-medical-triage", device_map="auto") - PEFT
How to use cristian-untaru/frozen-encoder-biomedbert-medical-triage with PEFT:
Task type is invalid.
- Notebooks
- Google Colab
- Kaggle
File size: 669 Bytes
abc6398 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 | {
"base_model": "microsoft/BiomedNLP-BiomedBERT-base-uncased-abstract-fulltext",
"adaptation_method": "Frozen Encoder + Trainable Classification Head",
"peft_type": "FROZEN_ENCODER",
"trainable_head_modules": [
"pooler",
"classifier"
],
"num_labels": 3,
"max_length": 128,
"num_train_epochs": 8,
"learning_rate": 0.0002,
"batch_size_train": 16,
"batch_size_eval": 32,
"weight_decay": 0.01,
"warmup_ratio": 0.1,
"fp16": true,
"early_stopping_patience": 3,
"metric_for_best_model": "f1",
"train_size": 490,
"validation_size": 105,
"test_size": 106,
"hf_repo_id": "cristian-untaru/frozen-encoder-biomedbert-medical-triage"
} |