Anurag33Gaikwad commited on
Commit
c00a5f4
·
verified ·
1 Parent(s): 3416e1a

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +5 -5
README.md CHANGED
@@ -63,20 +63,20 @@ This gives LED excellent performance on structural legal documents.
63
  | Setting | Value |
64
  |--------|--------|
65
  | Base model | nsi319/legal-led-base-16384 |
66
- | Epochs | 4 total |
67
- | Batch size | 1 |
68
- | Gradient accumulation | 8 |
69
  | Learning rate | 1e-5 |
70
  | Optimizer | AdamW |
71
  | Weight decay | 0.01 |
72
  | FP16 | Yes |
73
  | Warmup steps | 500 |
74
- | Max input length | 14,000 tokens |
75
  | Max output length | 512 tokens |
76
  | Attention | Global attention on first token |
77
  | Scheduler | Linear |
78
 
79
- Training was performed on **NVIDIA T4 (16GB VRAM)** via Kaggle.
80
 
81
  ---
82
 
 
63
  | Setting | Value |
64
  |--------|--------|
65
  | Base model | nsi319/legal-led-base-16384 |
66
+ | Epochs | 6 total |
67
+ | Batch size | 2 |
68
+ | Gradient accumulation | 2 |
69
  | Learning rate | 1e-5 |
70
  | Optimizer | AdamW |
71
  | Weight decay | 0.01 |
72
  | FP16 | Yes |
73
  | Warmup steps | 500 |
74
+ | Max input length | 4096 tokens |
75
  | Max output length | 512 tokens |
76
  | Attention | Global attention on first token |
77
  | Scheduler | Linear |
78
 
79
+ Training was performed on **NVIDIA P100 (16GB VRAM)** via Kaggle.
80
 
81
  ---
82