| --- |
| language: en |
| tags: |
| - bart |
| - seq2seq |
| - summarization |
| license: apache-2.0 |
| datasets: |
| - samsum |
| widget: |
| - text: | |
| Hannah: Hey, do you have Betty's number? |
| Amanda: Lemme check |
| Amanda: Sorry, can't find it. |
| Amanda: Ask Larry |
| Amanda: He called her last time we were at the park together |
| Hannah: I don't know him well |
| Amanda: Don't be shy, he's very nice |
| Hannah: If you say so.. |
| Hannah: I'd rather you texted him |
| Amanda: Just text him 🙂 |
| Hannah: Urgh.. Alright |
| Hannah: Bye |
| Amanda: Bye bye |
| model-index: |
| - name: bart-large-xsum-samsum |
| results: |
| - task: |
| name: Abstractive Text Summarization |
| type: abstractive-text-summarization |
| dataset: |
| name: "SAMSum Corpus: A Human-annotated Dialogue Dataset for Abstractive Summarization" |
| type: samsum |
| metrics: |
| - name: Validation ROUGE-1 |
| type: rouge-1 |
| value: 54.3921 |
| - name: Validation ROUGE-2 |
| type: rouge-2 |
| value: 29.8078 |
| - name: Validation ROUGE-L |
| type: rouge-l |
| value: 45.1543 |
| - name: Test ROUGE-1 |
| type: rouge-1 |
| value: 53.3059 |
| - name: Test ROUGE-2 |
| type: rouge-2 |
| value: 28.355 |
| - name: Test ROUGE-L |
| type: rouge-l |
| value: 44.0953 |
| --- |
| ## `bart-large-xsum-samsum` |
| This model was obtained by fine-tuning `facebook/bart-large-xsum` on [Samsum](https://huggingface.co/datasets/samsum) dataset. |
| ## Usage |
| ```python |
| from transformers import pipeline |
| |
| summarizer = pipeline("summarization", model="lidiya/bart-large-xsum-samsum") |
| conversation = '''Hannah: Hey, do you have Betty's number? |
| Amanda: Lemme check |
| Amanda: Sorry, can't find it. |
| Amanda: Ask Larry |
| Amanda: He called her last time we were at the park together |
| Hannah: I don't know him well |
| Amanda: Don't be shy, he's very nice |
| Hannah: If you say so.. |
| Hannah: I'd rather you texted him |
| Amanda: Just text him 🙂 |
| Hannah: Urgh.. Alright |
| Hannah: Bye |
| Amanda: Bye bye |
| ''' |
| summarizer(conversation) |
| ``` |
| ## Training procedure |
| - Colab notebook: https://colab.research.google.com/drive/1dul0Sg-TTMy9xZCJzmDRajXbyzDwtYx6?usp=sharing |
| ## Results |
| | key | value | |
| | --- | ----- | |
| | eval_rouge1 | 54.3921 | |
| | eval_rouge2 | 29.8078 | |
| | eval_rougeL | 45.1543 | |
| | eval_rougeLsum | 49.942 | |
| | test_rouge1 | 53.3059 | |
| | test_rouge2 | 28.355 | |
| | test_rougeL | 44.0953 | |
| | test_rougeLsum | 48.9246 | |
