Token Classification
Transformers
Safetensors
openai_privacy_filter
privacy
pii
ner
redaction
nemotron
openmed
openai-privacy-filter
Instructions to use OpenMed/privacy-filter-nemotron-v2 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use OpenMed/privacy-filter-nemotron-v2 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("token-classification", model="OpenMed/privacy-filter-nemotron-v2")# Load model directly from transformers import AutoTokenizer, AutoModelForTokenClassification tokenizer = AutoTokenizer.from_pretrained("OpenMed/privacy-filter-nemotron-v2") model = AutoModelForTokenClassification.from_pretrained("OpenMed/privacy-filter-nemotron-v2") - Notebooks
- Google Colab
- Kaggle
Update README.md
Browse files
README.md
CHANGED
|
@@ -42,23 +42,14 @@ private: true
|
|
| 42 |
|
| 43 |
# privacy-filter-nemotron-v2
|
| 44 |
|
| 45 |
-
`OpenMed/privacy-filter-nemotron-v2` is the second-generation
|
| 46 |
-
|
| 47 |
-
|
| 48 |
-
`OpenMed/privacy-filter-nemotron`, while using a broader training mix and a
|
| 49 |
-
more recall-oriented adaptation recipe. In practice, this v2 checkpoint should
|
| 50 |
-
perform better as a general PII masking and redaction model while preserving
|
| 51 |
-
the useful typed labels from the original Nemotron model.
|
| 52 |
-
|
| 53 |
-
The model is based on `openai/privacy-filter`, a 1.4B-parameter MoE token
|
| 54 |
-
classifier with roughly 50M active parameters per token. It predicts 221 BIOES
|
| 55 |
-
token classes:
|
| 56 |
|
| 57 |
- `O`
|
| 58 |
- 55 PII categories encoded as `B-*`, `I-*`, `E-*`, and `S-*`
|
| 59 |
|
| 60 |
-
Use this checkpoint when you want the Nemotron fine-grained label schema, but
|
| 61 |
-
prefer the improved v2 masking behavior.
|
| 62 |
|
| 63 |
## Relationship To The Original Nemotron Model
|
| 64 |
|
|
|
|
| 42 |
|
| 43 |
# privacy-filter-nemotron-v2
|
| 44 |
|
| 45 |
+
`OpenMed/privacy-filter-nemotron-v2` is the second-generation Nemotron-schema checkpoint in the OpenMed privacy-filter family. It keeps the same fine-grained 55-category PII vocabulary as `OpenMed/privacy-filter-nemotron`, while using a broader training mix and a more recall-oriented adaptation recipe. In practice, this v2 checkpoint should perform better as a general PII masking and redaction model while preserving the useful typed labels from the original Nemotron model.
|
| 46 |
+
|
| 47 |
+
The model is based on `openai/privacy-filter`, a 1.4B-parameter MoE token classifier with roughly 50M active parameters per token. It predicts 221 BIOES token classes:
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 48 |
|
| 49 |
- `O`
|
| 50 |
- 55 PII categories encoded as `B-*`, `I-*`, `E-*`, and `S-*`
|
| 51 |
|
| 52 |
+
Use this checkpoint when you want the Nemotron fine-grained label schema, but prefer the improved v2 masking behavior.
|
|
|
|
| 53 |
|
| 54 |
## Relationship To The Original Nemotron Model
|
| 55 |
|