Text Classification
Transformers
Safetensors
English
deberta-v2
safety
biosecurity
content-classification
constitutional-classifiers
deberta-v3
dual-use
nsabb
biology
Eval Results (legacy)
text-embeddings-inference
Instructions to use jang1563/constitutional-bioguard-deberta-v1 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use jang1563/constitutional-bioguard-deberta-v1 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-classification", model="jang1563/constitutional-bioguard-deberta-v1")# Load model directly from transformers import AutoTokenizer, AutoModelForSequenceClassification tokenizer = AutoTokenizer.from_pretrained("jang1563/constitutional-bioguard-deberta-v1") model = AutoModelForSequenceClassification.from_pretrained("jang1563/constitutional-bioguard-deberta-v1", device_map="auto") - Notebooks
- Google Colab
- Kaggle
De-emphasize in-distribution table: lead with real-world headline, label synthetic holdout
Browse files
README.md
CHANGED
|
@@ -108,7 +108,9 @@ see the Honest evaluation update at the top of this card.
|
|
| 108 |
|
| 109 |
## Performance
|
| 110 |
|
| 111 |
-
|
|
|
|
|
|
|
| 112 |
|
| 113 |
| Metric | Value |
|
| 114 |
|--------|-------|
|
|
|
|
| 108 |
|
| 109 |
## Performance
|
| 110 |
|
| 111 |
+
**Real-world headline first.** On *real* legitimate-research queries this line's over-refusal is roughly 18-19% (not the 0% below), and on real bio response-harm (n=554) its successor response head reaches recall 0.921 / AUROC 0.952 but is **Pareto-dominated by the openly-available Qwen3Guard-0.6B**. Everything below is **in-distribution, on a synthetic holdout generated by the same pipeline as the training data** — kept for completeness, not as real-world performance. See the honest summary at the top of this card.
|
| 112 |
+
|
| 113 |
+
### In-distribution metrics — synthetic holdout, not real-world (643-sample)
|
| 114 |
|
| 115 |
| Metric | Value |
|
| 116 |
|--------|-------|
|