Token Classification
Transformers
PyTorch
TensorFlow
ONNX
Safetensors
xlm-roberta
punctuation prediction
punctuation
Instructions to use oliverguhr/fullstop-punctuation-multilang-large with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use oliverguhr/fullstop-punctuation-multilang-large with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("token-classification", model="oliverguhr/fullstop-punctuation-multilang-large")# Load model directly from transformers import AutoTokenizer, AutoModelForTokenClassification tokenizer = AutoTokenizer.from_pretrained("oliverguhr/fullstop-punctuation-multilang-large") model = AutoModelForTokenClassification.from_pretrained("oliverguhr/fullstop-punctuation-multilang-large") - Inference
- Notebooks
- Google Colab
- Kaggle
Commit ·
345e80a
1
Parent(s): 3f0ece2
Copy the tokenizer.json from the onnx/ to the root folder (#10)
Browse files- Copy the tokenizer.json from the onnx/ to the root folder (64def0be28f3162463f67828ca88fa7004a174bb)
Co-authored-by: Libo <libooo@users.noreply.huggingface.co>
- .gitattributes +1 -0
- tokenizer.json +3 -0
.gitattributes
CHANGED
|
@@ -28,3 +28,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
|
| 28 |
model.safetensors filter=lfs diff=lfs merge=lfs -text
|
| 29 |
onnx/tokenizer.json filter=lfs diff=lfs merge=lfs -text
|
| 30 |
onnx/model.onnx_data filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
| 28 |
model.safetensors filter=lfs diff=lfs merge=lfs -text
|
| 29 |
onnx/tokenizer.json filter=lfs diff=lfs merge=lfs -text
|
| 30 |
onnx/model.onnx_data filter=lfs diff=lfs merge=lfs -text
|
| 31 |
+
tokenizer.json filter=lfs diff=lfs merge=lfs -text
|
tokenizer.json
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:de3788bb2f349135f2ad2e2b10dff3cee7f23fab906a5fbdadf20bc963b05b4c
|
| 3 |
+
size 17098080
|