Summarization
Transformers
Safetensors
t5
text2text-generation
Generated from Trainer
compression
prompt-summarization
prompt-compression
text_summarization
text_compression
text-generation-inference
Instructions to use gravitee-io/very-small-prompt-compression with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use gravitee-io/very-small-prompt-compression with Transformers:
# Use a pipeline as a high-level helper # Warning: Pipeline type "summarization" is no longer supported in transformers v5. # You must load the model directly (see below) or downgrade to v4.x with: # 'pip install "transformers<5.0.0' from transformers import pipeline pipe = pipeline("summarization", model="gravitee-io/very-small-prompt-compression")# Load model directly from transformers import AutoTokenizer, AutoModelForMultimodalLM tokenizer = AutoTokenizer.from_pretrained("gravitee-io/very-small-prompt-compression") model = AutoModelForMultimodalLM.from_pretrained("gravitee-io/very-small-prompt-compression") - Notebooks
- Google Colab
- Kaggle
File size: 5,774 Bytes
72dd7f6 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 | π Epoch 1 β 2025-10-25T00:02:36 ---------------------------------------------------------------------------------------------------- π’ Sample 1 Input(26 tok): Which of the following is a database or Streaming solution? Oracle, Kinesis, Event hub, SQL Server... Pred (21 tok): Which is database or Streaming solution? Oracle, Kinesis, Event hub, SQL Server... Ref (23 tok): Which of following is database or Streaming solution? Oracle, Kinesis, Event hub, SQL Server... ---------------------------------------------------------------------------------------------------- π’ Sample 2 Input(11 tok): What is the fastest time control chess?... Pred (8 tok): Fastest time control chess... Ref (8 tok): Fastest chess time control... ---------------------------------------------------------------------------------------------------- π’ Sample 3 Input(12 tok): What is the length of an Olympic size swimming pool?... Pred (6 tok): Olympic size swimming pool length... Ref (4 tok): Olympic pool length... ---------------------------------------------------------------------------------------------------- π Epoch 2 β 2025-10-25T00:16:41 ---------------------------------------------------------------------------------------------------- π’ Sample 1 Input(20 tok): Who were the commanders of the two armies involved in the Battle of Hastings?... Pred (16 tok): Who were commanders of two armies involved in Battle of Hastings... Ref (13 tok): Battle of Hastings: commanders of both armies... ---------------------------------------------------------------------------------------------------- π’ Sample 2 Input(16 tok): Which countries are part of the five eyes alliance and what is its purpose?... Pred (12 tok): Which countries are part of five eyes alliance and its purpose... Ref (8 tok): Five Eyes members and alliance purpose... ---------------------------------------------------------------------------------------------------- π’ Sample 3 Input(13 tok): What is the highest-grossing film worldwide?... Pred (9 tok): highest-grossing film worldwide... Ref (9 tok): Worldwide highest-grossing film... ---------------------------------------------------------------------------------------------------- π Epoch 3 β 2025-10-25T00:30:47 ---------------------------------------------------------------------------------------------------- π’ Sample 1 Input(23 tok): Write a friendly complaint to an airline service about a poor experience with multiple issues and ask for points.... Pred (17 tok): Write friendly complaint to airline service about poor experience with multiple issues and ask for points... Ref (17 tok): Write friendly complaint to airline service about poor experience with multiple issues and ask for points... ---------------------------------------------------------------------------------------------------- π’ Sample 2 Input(17 tok): Write a paragraph on why visit and stay at Marysville in Victoria Australia.... Pred (14 tok): Write paragraph on why visit and stay at Marysville in Victoria Australia... Ref (14 tok): Write paragraph on why visit and stay at Marysville in Victoria Australia... ---------------------------------------------------------------------------------------------------- π’ Sample 3 Input(19 tok): Find the bird in this list: Arctic skua, Monkey, Lily... Pred (18 tok): Find bird in this list: Arctic skua, Monkey, Lily... Ref (17 tok): Find bird in list: Arctic skua, Monkey, Lily... ---------------------------------------------------------------------------------------------------- π Epoch 4 β 2025-10-25T00:45:25 ---------------------------------------------------------------------------------------------------- π’ Sample 1 Input(31 tok): Given this paragraph about roasting peanuts to make peanut butter, what temperature are peanuts roasted using the batch method in celsius?... Pred (29 tok): From this paragraph about roasting peanuts to make peanut butter, what temperature are peanuts roasted using batch method in celsius... Ref (27 tok): From this paragraph about roasting peanuts for peanut butter, what batch-roasting temperature (Β°C) is used... ---------------------------------------------------------------------------------------------------- π’ Sample 2 Input(17 tok): Who were Jaehaerys I Targaryen's children?... Pred (16 tok): Who were Jaehaerys I Targaryen's children... Ref (14 tok): Jaehaerys I Targaryen's children... ---------------------------------------------------------------------------------------------------- π’ Sample 3 Input(8 tok): Which drum kit should I buy?... Pred (6 tok): Which drum kit to buy... Ref (6 tok): Which drum kit to buy... ---------------------------------------------------------------------------------------------------- π Epoch 5 β 2025-10-25T00:59:55 ---------------------------------------------------------------------------------------------------- π’ Sample 1 Input(8 tok): Who was Bosch's dad?... Pred (5 tok): Bosch's dad... Ref (5 tok): Bosch's dad... ---------------------------------------------------------------------------------------------------- π’ Sample 2 Input(24 tok): Make me a list of the oldest board games that I might not know about, and where they were invented.... Pred (16 tok): List oldest board games I might not know about, and where they were invented... Ref (11 tok): List obscure oldest board games and where they were invented... ---------------------------------------------------------------------------------------------------- π’ Sample 3 Input(6 tok): Can Penguins fly?... Pred (5 tok): Can Penguins fly... Ref (5 tok): Can Penguins fly... ---------------------------------------------------------------------------------------------------- |