Token Classification
Scikit-learn
PyTorch
TensorBoard
Safetensors
Transformers
English
distilbert
ner
mlflow
openchs
Eval Results (legacy)
Instructions to use openchs/ner_distillbert_v1 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Scikit-learn
How to use openchs/ner_distillbert_v1 with Scikit-learn:
from huggingface_hub import hf_hub_download import joblib model = joblib.load( hf_hub_download("openchs/ner_distillbert_v1", "sklearn_model.joblib") ) # only load pickle files from sources you trust # read more about it here https://skops.readthedocs.io/en/stable/persistence.html - Transformers
How to use openchs/ner_distillbert_v1 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("token-classification", model="openchs/ner_distillbert_v1")# Load model directly from transformers import AutoTokenizer, AutoModelForTokenClassification tokenizer = AutoTokenizer.from_pretrained("openchs/ner_distillbert_v1") model = AutoModelForTokenClassification.from_pretrained("openchs/ner_distillbert_v1", device_map="auto") - Notebooks
- Google Colab
- Kaggle
| import torch | |
| import json | |
| from typing import Any, List | |
| class PyTorchModel: | |
| def __init__(self): | |
| # Load model info | |
| with open("model_info.json", "r") as f: | |
| self.model_info = json.load(f) | |
| # Note: You'll need to reconstruct the model architecture | |
| # and load the state dict | |
| # self.model = YourModelClass() # Define your model class | |
| # self.model.load_state_dict(torch.load("pytorch_model.bin")) | |
| # self.model.eval() | |
| def predict(self, inputs: List[Any]): | |
| """Make predictions""" | |
| # Implement your prediction logic | |
| # with torch.no_grad(): | |
| # outputs = self.model(processed_inputs) | |
| # return outputs | |
| pass | |