| --- |
| language: it |
| datasets: |
| - xtreme |
| --- |
| |
| # Italian-Bert (Italian Bert) + POS 🎃🏷 |
|
|
| This model is a fine-tuned on [xtreme udpos Italian](https://huggingface.co/nlp/viewer/?dataset=xtreme&config=udpos.Italian) version of [Bert Base Italian](https://huggingface.co/dbmdz/bert-base-italian-cased) for **POS** downstream task. |
|
|
| ## Details of the downstream task (POS) - Dataset |
|
|
| - [Dataset: xtreme udpos Italian](https://huggingface.co/nlp/viewer/?dataset=xtreme&config=udpos.Italian) 📚 |
|
|
| | Dataset | # Examples | |
| | ---------------------- | ----- | |
| | Train | 716 K | |
| | Dev | 85 K | |
|
|
| - [Fine-tune on NER script provided by @stefan-it](https://raw.githubusercontent.com/stefan-it/fine-tuned-berts-seq/master/scripts/preprocess.py) |
|
|
| - Labels covered: |
|
|
| ``` |
| ADJ |
| ADP |
| ADV |
| AUX |
| CCONJ |
| DET |
| INTJ |
| NOUN |
| NUM |
| PART |
| PRON |
| PROPN |
| PUNCT |
| SCONJ |
| SYM |
| VERB |
| X |
| ``` |
|
|
| ## Metrics on evaluation set 🧾 |
|
|
| | Metric | # score | |
| | :------------------------------------------------------------------------------------: | :-------: | |
| | F1 | **97.25** |
| | Precision | **97.15** | |
| | Recall | **97.36** | |
|
|
| ## Model in action 🔨 |
|
|
|
|
| Example of usage |
|
|
| ```python |
| from transformers import pipeline |
| |
| nlp_pos = pipeline( |
| "ner", |
| model="sachaarbonel/bert-italian-cased-finetuned-pos", |
| tokenizer=( |
| 'sachaarbonel/bert-spanish-cased-finetuned-pos', |
| {"use_fast": False} |
| )) |
| |
| |
| text = 'Roma è la Capitale d'Italia.' |
| |
| nlp_pos(text) |
| |
| ''' |
| Output: |
| -------- |
| [{'entity': 'PROPN', 'index': 1, 'score': 0.9995346665382385, 'word': 'roma'}, |
| {'entity': 'AUX', 'index': 2, 'score': 0.9966597557067871, 'word': 'e'}, |
| {'entity': 'DET', 'index': 3, 'score': 0.9994786977767944, 'word': 'la'}, |
| {'entity': 'NOUN', |
| 'index': 4, |
| 'score': 0.9995198249816895, |
| 'word': 'capitale'}, |
| {'entity': 'ADP', 'index': 5, 'score': 0.9990894198417664, 'word': 'd'}, |
| {'entity': 'PART', 'index': 6, 'score': 0.57159024477005, 'word': "'"}, |
| {'entity': 'PROPN', |
| 'index': 7, |
| 'score': 0.9994804263114929, |
| 'word': 'italia'}, |
| {'entity': 'PUNCT', 'index': 8, 'score': 0.9772886633872986, 'word': '.'}] |
| ''' |
| ``` |
| Yeah! Not too bad 🎉 |
|
|
| > Created by [Sacha Arbonel/@sachaarbonel](https://twitter.com/sachaarbonel) | [LinkedIn](https://www.linkedin.com/in/sacha-arbonel) |
|
|
| > Made with <span style="color: #e25555;">♥</span> in Paris |
|
|
