legal-pegasus-finetuned

This model is a fine-tuned version of nsi319/legal-pegasus on an unknown dataset. It achieves the following results on the evaluation set:

• Loss: 1.8398
• Rouge1: 50.3753
• Rouge2: 26.0732
• Rougel: 34.4429
• Rougelsum: 34.4336

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Use adamw_torch_fused with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
• lr_scheduler_type: linear
• num_epochs: 3
• mixed_precision_training: Native AMP

Training results

Training Loss	Epoch	Step	Validation Loss	Rouge1	Rouge2	Rougel	Rougelsum
2.1848	1.0	791	1.8913	49.8438	25.3784	33.6503	33.6705
2.0197	2.0	1582	1.8517	50.4076	26.1167	34.4954	34.5018
1.976	3.0	2373	1.8398	50.3753	26.0732	34.4429	34.4336

Framework versions

• Transformers 4.56.1
• Pytorch 2.8.0+cu128
• Datasets 4.0.0
• Tokenizers 0.22.0