Upload trained ASL Transformer 84-class 408D model
Browse files- README.md +111 -0
- best_transformer_asl_84class.pt +3 -0
- best_val_preds.npy +3 -0
- best_val_targets.npy +3 -0
- classification_report.csv +88 -0
- config.json +28 -0
- confusion_matrix.npy +3 -0
- id_to_label.json +86 -0
- last_transformer_asl_84class.pt +3 -0
- training_history.csv +61 -0
- training_summary.json +11 -0
README.md
ADDED
|
@@ -0,0 +1,111 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: other
|
| 3 |
+
library_name: pytorch
|
| 4 |
+
tags:
|
| 5 |
+
- asl
|
| 6 |
+
- sign-language
|
| 7 |
+
- transformer
|
| 8 |
+
- mediapipe
|
| 9 |
+
- holistic
|
| 10 |
+
- keypoints
|
| 11 |
+
- pytorch
|
| 12 |
+
- isolated-sign-recognition
|
| 13 |
+
- 84-classes
|
| 14 |
+
- 408d-features
|
| 15 |
+
---
|
| 16 |
+
|
| 17 |
+
# ASL Transformer 84-Class 408D Model
|
| 18 |
+
|
| 19 |
+
This repository contains a trained PyTorch Transformer model for isolated American Sign Language classification using MediaPipe Holistic keypoint features.
|
| 20 |
+
|
| 21 |
+
## Model Performance
|
| 22 |
+
|
| 23 |
+
- Validation Top-1 Accuracy: **72.87%**
|
| 24 |
+
- Validation Top-5 Accuracy: **90.15%**
|
| 25 |
+
- Number of classes: **84**
|
| 26 |
+
- Input sequence length: **50**
|
| 27 |
+
- Input feature dimension: **408**
|
| 28 |
+
|
| 29 |
+
## Important Files
|
| 30 |
+
|
| 31 |
+
- `best_transformer_asl_84class.pt` — best trained checkpoint
|
| 32 |
+
- `last_transformer_asl_84class.pt` — final checkpoint from training
|
| 33 |
+
- `config.json` — model/training configuration
|
| 34 |
+
- `id_to_label.json` — class ID to label mapping
|
| 35 |
+
- `training_history.csv` — epoch-by-epoch training history
|
| 36 |
+
- `classification_report.csv` — validation classification report
|
| 37 |
+
- `confusion_matrix.npy` — validation confusion matrix
|
| 38 |
+
- `training_summary.json` — final training summary
|
| 39 |
+
|
| 40 |
+
## Input Format
|
| 41 |
+
|
| 42 |
+
The model expects input shaped:
|
| 43 |
+
|
| 44 |
+
```python
|
| 45 |
+
(batch_size, 50, 408)
|
| 46 |
+
```
|
| 47 |
+
|
| 48 |
+
Where:
|
| 49 |
+
|
| 50 |
+
- `50` = sequence length
|
| 51 |
+
- `408` = 204 normalized keypoint features + 204 velocity features
|
| 52 |
+
|
| 53 |
+
## Training Summary
|
| 54 |
+
|
| 55 |
+
```json
|
| 56 |
+
{
|
| 57 |
+
"best_epoch": 60,
|
| 58 |
+
"best_val_top1": 0.7287202392305646,
|
| 59 |
+
"final_val_loss": 1.4968034369604928,
|
| 60 |
+
"final_val_top1": 0.7287202392305646,
|
| 61 |
+
"final_val_top5": 0.9014880997794015,
|
| 62 |
+
"total_training_time_sec": 265.57665967941284,
|
| 63 |
+
"total_training_time": "04m 25s",
|
| 64 |
+
"best_checkpoint": "/kaggle/working/asl_transformer_84class_run/best_transformer_asl_84class.pt",
|
| 65 |
+
"last_checkpoint": "/kaggle/working/asl_transformer_84class_run/last_transformer_asl_84class.pt"
|
| 66 |
+
}
|
| 67 |
+
```
|
| 68 |
+
|
| 69 |
+
## Config
|
| 70 |
+
|
| 71 |
+
```json
|
| 72 |
+
{
|
| 73 |
+
"data_dir": "/kaggle/working/training_model23_final_train_ready",
|
| 74 |
+
"output_dir": "/kaggle/working/asl_transformer_84class_run",
|
| 75 |
+
"seq_len": 50,
|
| 76 |
+
"input_dim": 408,
|
| 77 |
+
"num_classes": 84,
|
| 78 |
+
"d_model": 256,
|
| 79 |
+
"nhead": 4,
|
| 80 |
+
"num_layers": 3,
|
| 81 |
+
"dim_feedforward": 512,
|
| 82 |
+
"dropout": 0.3,
|
| 83 |
+
"batch_size": 64,
|
| 84 |
+
"epochs": 60,
|
| 85 |
+
"max_lr": 0.0006,
|
| 86 |
+
"weight_decay": 0.0001,
|
| 87 |
+
"label_smoothing": 0.05,
|
| 88 |
+
"grad_clip": 1.0,
|
| 89 |
+
"patience": 10,
|
| 90 |
+
"num_workers": 2,
|
| 91 |
+
"pin_memory": true,
|
| 92 |
+
"use_augmentation": true,
|
| 93 |
+
"noise_std": 0.01,
|
| 94 |
+
"feature_dropout_prob": 0.03,
|
| 95 |
+
"time_mask_prob": 0.15,
|
| 96 |
+
"time_mask_max_len": 6,
|
| 97 |
+
"seed": 42,
|
| 98 |
+
"use_amp": true
|
| 99 |
+
}
|
| 100 |
+
```
|
| 101 |
+
|
| 102 |
+
## Notes
|
| 103 |
+
|
| 104 |
+
During inference, use the same preprocessing pipeline used during training:
|
| 105 |
+
|
| 106 |
+
1. Extract MediaPipe Holistic keypoints.
|
| 107 |
+
2. Normalize keypoints the same way as training.
|
| 108 |
+
3. Build a 50-frame sequence.
|
| 109 |
+
4. Add velocity features to convert 204D input into 408D input.
|
| 110 |
+
5. Feed tensor shaped `(1, 50, 408)` into the model.
|
| 111 |
+
6. Convert predicted class ID using `id_to_label.json`.
|
best_transformer_asl_84class.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:cb087c33f3028cec493b220b50b9ceb8214a5cac0778c7b8c5ea55892abc15eb
|
| 3 |
+
size 21398329
|
best_val_preds.npy
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:286784dca603a8b5f3d8d27ab148ca575e37902b173bad00dbe4779615f06433
|
| 3 |
+
size 7024
|
best_val_targets.npy
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:6644c11017cf982249eddb3d1b9cf7fdc1b9ee6b9d1e2c0306b046f1516b8edb
|
| 3 |
+
size 7024
|
classification_report.csv
ADDED
|
@@ -0,0 +1,88 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
,precision,recall,f1-score,support
|
| 2 |
+
4,0.9090909090909091,0.8333333333333334,0.8695652173913043,12.0
|
| 3 |
+
20,0.7142857142857143,0.8333333333333334,0.7692307692307693,12.0
|
| 4 |
+
47,0.6666666666666666,0.6666666666666666,0.6666666666666666,12.0
|
| 5 |
+
49,0.6363636363636364,0.7777777777777778,0.7,9.0
|
| 6 |
+
51,0.6,0.6666666666666666,0.631578947368421,9.0
|
| 7 |
+
74,0.625,0.5555555555555556,0.5882352941176471,9.0
|
| 8 |
+
84,0.7777777777777778,0.5833333333333334,0.6666666666666666,12.0
|
| 9 |
+
97,0.9285714285714286,0.8666666666666667,0.896551724137931,15.0
|
| 10 |
+
105,0.7,0.7777777777777778,0.7368421052631579,9.0
|
| 11 |
+
108,0.5714285714285714,0.4444444444444444,0.5,9.0
|
| 12 |
+
109,0.875,0.7777777777777778,0.8235294117647058,9.0
|
| 13 |
+
113,0.8333333333333334,0.8333333333333334,0.8333333333333334,12.0
|
| 14 |
+
140,0.8888888888888888,0.6666666666666666,0.7619047619047619,12.0
|
| 15 |
+
155,0.5,0.7777777777777778,0.6086956521739131,9.0
|
| 16 |
+
156,0.6666666666666666,0.5,0.5714285714285714,12.0
|
| 17 |
+
157,0.6363636363636364,0.7777777777777778,0.7,9.0
|
| 18 |
+
168,0.8571428571428571,0.6666666666666666,0.75,9.0
|
| 19 |
+
174,0.8,0.8888888888888888,0.8421052631578947,9.0
|
| 20 |
+
184,0.631578947368421,0.8,0.7058823529411765,15.0
|
| 21 |
+
190,0.7,0.5833333333333334,0.6363636363636364,12.0
|
| 22 |
+
209,0.6363636363636364,0.7777777777777778,0.7,9.0
|
| 23 |
+
235,0.875,0.7777777777777778,0.8235294117647058,9.0
|
| 24 |
+
246,0.6363636363636364,0.5833333333333334,0.6086956521739131,12.0
|
| 25 |
+
274,0.7777777777777778,0.5833333333333334,0.6666666666666666,12.0
|
| 26 |
+
278,0.6428571428571429,0.75,0.6923076923076923,12.0
|
| 27 |
+
292,0.6111111111111112,0.9166666666666666,0.7333333333333333,12.0
|
| 28 |
+
298,0.7272727272727273,0.8888888888888888,0.8,9.0
|
| 29 |
+
301,0.9166666666666666,0.9166666666666666,0.9166666666666666,12.0
|
| 30 |
+
319,1.0,0.7777777777777778,0.875,9.0
|
| 31 |
+
321,0.6666666666666666,0.8333333333333334,0.7407407407407407,12.0
|
| 32 |
+
326,0.5,0.5333333333333333,0.5161290322580645,15.0
|
| 33 |
+
359,0.8181818181818182,0.75,0.782608695652174,12.0
|
| 34 |
+
380,0.8,0.8888888888888888,0.8421052631578947,9.0
|
| 35 |
+
405,0.7857142857142857,0.7333333333333333,0.7586206896551724,15.0
|
| 36 |
+
406,0.8181818181818182,1.0,0.9,9.0
|
| 37 |
+
428,0.5,0.4444444444444444,0.47058823529411764,9.0
|
| 38 |
+
440,1.0,0.6666666666666666,0.8,12.0
|
| 39 |
+
447,0.9,0.8181818181818182,0.8571428571428571,11.0
|
| 40 |
+
466,0.7,0.7777777777777778,0.7368421052631579,9.0
|
| 41 |
+
519,0.75,0.3333333333333333,0.46153846153846156,9.0
|
| 42 |
+
566,0.8,0.6666666666666666,0.7272727272727273,12.0
|
| 43 |
+
594,0.625,0.5555555555555556,0.5882352941176471,9.0
|
| 44 |
+
611,0.7,0.7777777777777778,0.7368421052631579,9.0
|
| 45 |
+
624,0.8181818181818182,1.0,0.9,9.0
|
| 46 |
+
627,0.6153846153846154,0.8888888888888888,0.7272727272727273,9.0
|
| 47 |
+
634,0.6153846153846154,0.8888888888888888,0.7272727272727273,9.0
|
| 48 |
+
660,0.7333333333333333,0.9166666666666666,0.8148148148148148,12.0
|
| 49 |
+
681,0.5625,0.6428571428571429,0.6,14.0
|
| 50 |
+
748,0.875,0.7777777777777778,0.8235294117647058,9.0
|
| 51 |
+
788,0.8,0.8888888888888888,0.8421052631578947,9.0
|
| 52 |
+
790,0.8461538461538461,0.9166666666666666,0.88,12.0
|
| 53 |
+
792,0.7142857142857143,0.5555555555555556,0.625,9.0
|
| 54 |
+
805,1.0,0.5833333333333334,0.7368421052631579,12.0
|
| 55 |
+
814,0.7142857142857143,0.5555555555555556,0.625,9.0
|
| 56 |
+
833,0.5555555555555556,0.5555555555555556,0.5555555555555556,9.0
|
| 57 |
+
841,0.6666666666666666,0.8888888888888888,0.7619047619047619,9.0
|
| 58 |
+
850,0.75,0.6666666666666666,0.7058823529411765,9.0
|
| 59 |
+
876,0.6666666666666666,0.6666666666666666,0.6666666666666666,12.0
|
| 60 |
+
894,0.8888888888888888,0.8888888888888888,0.8888888888888888,9.0
|
| 61 |
+
900,0.6666666666666666,0.36363636363636365,0.47058823529411764,11.0
|
| 62 |
+
907,0.9,0.75,0.8181818181818182,12.0
|
| 63 |
+
921,0.6666666666666666,0.8888888888888888,0.7619047619047619,9.0
|
| 64 |
+
960,0.6,0.6666666666666666,0.631578947368421,9.0
|
| 65 |
+
983,0.5,0.5555555555555556,0.5263157894736842,9.0
|
| 66 |
+
1006,0.6666666666666666,0.6666666666666666,0.6666666666666666,9.0
|
| 67 |
+
1008,1.0,0.75,0.8571428571428571,12.0
|
| 68 |
+
1047,0.8888888888888888,0.8888888888888888,0.8888888888888888,9.0
|
| 69 |
+
1052,0.8181818181818182,1.0,0.9,9.0
|
| 70 |
+
1061,0.45454545454545453,0.5555555555555556,0.5,9.0
|
| 71 |
+
1076,0.7272727272727273,0.8888888888888888,0.8,9.0
|
| 72 |
+
1083,1.0,0.7777777777777778,0.875,9.0
|
| 73 |
+
1096,0.875,0.7777777777777778,0.8235294117647058,9.0
|
| 74 |
+
1116,1.0,0.7777777777777778,0.875,9.0
|
| 75 |
+
1138,0.8333333333333334,0.8333333333333334,0.8333333333333334,12.0
|
| 76 |
+
1182,0.6428571428571429,1.0,0.782608695652174,9.0
|
| 77 |
+
1200,0.4444444444444444,0.4444444444444444,0.4444444444444444,9.0
|
| 78 |
+
1213,0.8888888888888888,0.8888888888888888,0.8888888888888888,9.0
|
| 79 |
+
1216,0.7,0.875,0.7777777777777778,8.0
|
| 80 |
+
1409,0.6,0.6666666666666666,0.631578947368421,9.0
|
| 81 |
+
1432,1.0,0.8888888888888888,0.9411764705882353,9.0
|
| 82 |
+
1573,0.8333333333333334,0.9090909090909091,0.8695652173913043,11.0
|
| 83 |
+
1681,0.6666666666666666,0.4444444444444444,0.5333333333333333,9.0
|
| 84 |
+
1828,0.5,0.3333333333333333,0.4,9.0
|
| 85 |
+
1932,0.6,0.3333333333333333,0.42857142857142855,9.0
|
| 86 |
+
accuracy,0.728538283062645,0.728538283062645,0.728538283062645,0.728538283062645
|
| 87 |
+
macro avg,0.7381073387417372,0.7290064763279049,0.7238125856395006,862.0
|
| 88 |
+
weighted avg,0.7413158955059675,0.728538283062645,0.7253289240822531,862.0
|
config.json
ADDED
|
@@ -0,0 +1,28 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"data_dir": "/kaggle/working/training_model23_final_train_ready",
|
| 3 |
+
"output_dir": "/kaggle/working/asl_transformer_84class_run",
|
| 4 |
+
"seq_len": 50,
|
| 5 |
+
"input_dim": 408,
|
| 6 |
+
"num_classes": 84,
|
| 7 |
+
"d_model": 256,
|
| 8 |
+
"nhead": 4,
|
| 9 |
+
"num_layers": 3,
|
| 10 |
+
"dim_feedforward": 512,
|
| 11 |
+
"dropout": 0.3,
|
| 12 |
+
"batch_size": 64,
|
| 13 |
+
"epochs": 60,
|
| 14 |
+
"max_lr": 0.0006,
|
| 15 |
+
"weight_decay": 0.0001,
|
| 16 |
+
"label_smoothing": 0.05,
|
| 17 |
+
"grad_clip": 1.0,
|
| 18 |
+
"patience": 10,
|
| 19 |
+
"num_workers": 2,
|
| 20 |
+
"pin_memory": true,
|
| 21 |
+
"use_augmentation": true,
|
| 22 |
+
"noise_std": 0.01,
|
| 23 |
+
"feature_dropout_prob": 0.03,
|
| 24 |
+
"time_mask_prob": 0.15,
|
| 25 |
+
"time_mask_max_len": 6,
|
| 26 |
+
"seed": 42,
|
| 27 |
+
"use_amp": true
|
| 28 |
+
}
|
confusion_matrix.npy
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:aaa859e39181028891a90eb3d97c9bd8491c1ff3996f90b44f4fe3506d55de8a
|
| 3 |
+
size 56576
|
id_to_label.json
ADDED
|
@@ -0,0 +1,86 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"0": "4",
|
| 3 |
+
"1": "20",
|
| 4 |
+
"2": "47",
|
| 5 |
+
"3": "49",
|
| 6 |
+
"4": "51",
|
| 7 |
+
"5": "74",
|
| 8 |
+
"6": "84",
|
| 9 |
+
"7": "97",
|
| 10 |
+
"8": "105",
|
| 11 |
+
"9": "108",
|
| 12 |
+
"10": "109",
|
| 13 |
+
"11": "113",
|
| 14 |
+
"12": "140",
|
| 15 |
+
"13": "155",
|
| 16 |
+
"14": "156",
|
| 17 |
+
"15": "157",
|
| 18 |
+
"16": "168",
|
| 19 |
+
"17": "174",
|
| 20 |
+
"18": "184",
|
| 21 |
+
"19": "190",
|
| 22 |
+
"20": "209",
|
| 23 |
+
"21": "235",
|
| 24 |
+
"22": "246",
|
| 25 |
+
"23": "274",
|
| 26 |
+
"24": "278",
|
| 27 |
+
"25": "292",
|
| 28 |
+
"26": "298",
|
| 29 |
+
"27": "301",
|
| 30 |
+
"28": "319",
|
| 31 |
+
"29": "321",
|
| 32 |
+
"30": "326",
|
| 33 |
+
"31": "359",
|
| 34 |
+
"32": "380",
|
| 35 |
+
"33": "405",
|
| 36 |
+
"34": "406",
|
| 37 |
+
"35": "428",
|
| 38 |
+
"36": "440",
|
| 39 |
+
"37": "447",
|
| 40 |
+
"38": "466",
|
| 41 |
+
"39": "519",
|
| 42 |
+
"40": "566",
|
| 43 |
+
"41": "594",
|
| 44 |
+
"42": "611",
|
| 45 |
+
"43": "624",
|
| 46 |
+
"44": "627",
|
| 47 |
+
"45": "634",
|
| 48 |
+
"46": "660",
|
| 49 |
+
"47": "681",
|
| 50 |
+
"48": "748",
|
| 51 |
+
"49": "788",
|
| 52 |
+
"50": "790",
|
| 53 |
+
"51": "792",
|
| 54 |
+
"52": "805",
|
| 55 |
+
"53": "814",
|
| 56 |
+
"54": "833",
|
| 57 |
+
"55": "841",
|
| 58 |
+
"56": "850",
|
| 59 |
+
"57": "876",
|
| 60 |
+
"58": "894",
|
| 61 |
+
"59": "900",
|
| 62 |
+
"60": "907",
|
| 63 |
+
"61": "921",
|
| 64 |
+
"62": "960",
|
| 65 |
+
"63": "983",
|
| 66 |
+
"64": "1006",
|
| 67 |
+
"65": "1008",
|
| 68 |
+
"66": "1047",
|
| 69 |
+
"67": "1052",
|
| 70 |
+
"68": "1061",
|
| 71 |
+
"69": "1076",
|
| 72 |
+
"70": "1083",
|
| 73 |
+
"71": "1096",
|
| 74 |
+
"72": "1116",
|
| 75 |
+
"73": "1138",
|
| 76 |
+
"74": "1182",
|
| 77 |
+
"75": "1200",
|
| 78 |
+
"76": "1213",
|
| 79 |
+
"77": "1216",
|
| 80 |
+
"78": "1409",
|
| 81 |
+
"79": "1432",
|
| 82 |
+
"80": "1573",
|
| 83 |
+
"81": "1681",
|
| 84 |
+
"82": "1828",
|
| 85 |
+
"83": "1932"
|
| 86 |
+
}
|
last_transformer_asl_84class.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:faf7710368559e870791dfbfe679eb547f188a47196966efc13116157ec470d6
|
| 3 |
+
size 21398329
|
training_history.csv
ADDED
|
@@ -0,0 +1,61 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
epoch,train_loss,train_top1,train_top5,val_loss,val_top1,val_top5,lr,epoch_time_sec,total_time_sec
|
| 2 |
+
1,4.387773576772438,0.026426886788235522,0.10461084903129991,4.319517714636667,0.044940476438828876,0.15840773923056467,6.921442648649592e-05,5.432502031326294,5.433011770248413
|
| 3 |
+
2,4.213002065442643,0.06664504715294209,0.21067216964262836,4.098347425460815,0.11458333368812289,0.2851190481867109,9.622877516468685e-05,4.458653450012207,9.996822118759155
|
| 4 |
+
3,3.963967298561672,0.10837853770211058,0.3177889149706319,3.807856951441084,0.16175595351627894,0.39159226417541504,0.00013919918136808587,4.308624029159546,14.408969640731812
|
| 5 |
+
4,3.665901615934552,0.16247641506060115,0.41854952809945595,3.5486643654959544,0.20877976289817265,0.4394345262220928,0.00019519269954812934,4.169595718383789,18.700549840927124
|
| 6 |
+
5,3.358441073939485,0.21543042446082494,0.5094280659027819,3.2316349744796753,0.2523065486124584,0.5529017874172756,0.0002603874915048892,4.168525218963623,22.97844099998474
|
| 7 |
+
6,3.086864556906358,0.27658018863426065,0.5868514146444932,2.989608645439148,0.28258928656578064,0.6136160748345512,0.0003303336859954918,4.121694803237915,27.2102530002594
|
| 8 |
+
7,2.8795572811702512,0.31720518869049147,0.643885613050101,2.783003125871931,0.3319940481867109,0.6560267891202655,0.0004002571047447978,4.318153381347656,31.633313417434692
|
| 9 |
+
8,2.6855588049258827,0.3687087263701097,0.6909846697213515,2.6242083651678905,0.3662946437086378,0.6944196479661124,0.00046538512403614124,4.100586891174316,35.84569048881531
|
| 10 |
+
9,2.5331132501926064,0.3954304243033787,0.7232016504935499,2.551598463739668,0.3975446437086378,0.702604170356478,0.0005212724301956611,4.209133148193359,40.16917705535889
|
| 11 |
+
10,2.37924535656875,0.43859669791077666,0.7558431602873892,2.3879068919590543,0.4225446454116276,0.7456101221697671,0.0005641044345260602,4.065836429595947,44.34131050109863
|
| 12 |
+
11,2.24034772166666,0.47050117912157524,0.7834080187779553,2.308416281427656,0.43831845479352133,0.7693452409335545,0.0005909576381001402,4.197285175323486,48.640193939208984
|
| 13 |
+
12,2.083938758328276,0.5215566034586925,0.8187382075021852,2.2796949488776073,0.474032740507807,0.7607886918953487,0.0005999999428702565,4.3045172691345215,53.05164432525635
|
| 14 |
+
13,2.002425968647003,0.5505129717430979,0.8270165093664853,2.1339269961629594,0.5030505976506642,0.7991815507411957,0.0005993461594270863,4.125059366226196,57.2854585647583
|
| 15 |
+
14,1.9019230345510088,0.5704186319742562,0.8515035375109259,2.088238537311554,0.49650297846112934,0.8040922667298999,0.0005974118144188475,4.226335048675537,61.62285017967224
|
| 16 |
+
15,1.797916314511929,0.605283018553032,0.8661615561764195,1.969933705670493,0.5503720257963453,0.8364583381584713,0.0005942051910078317,4.190885782241821,65.87255620956421
|
| 17 |
+
16,1.6887746160885073,0.6295400942271611,0.8845224054354541,1.9724278109414237,0.5607142874172756,0.8163690524441856,0.0005897400204477745,4.278129816055298,70.26371955871582
|
| 18 |
+
17,1.606391600842746,0.66487617931276,0.897977593934761,2.009814126150949,0.5333333356039864,0.829910716840199,0.0005840354232845197,4.3610992431640625,74.73242568969727
|
| 19 |
+
18,1.5436108089842886,0.6816568397126108,0.9080660376908645,1.8670815570013863,0.5835565498897007,0.8383928622518267,0.0005771158274789059,4.252869367599487,79.04466938972473
|
| 20 |
+
19,1.4730093063048597,0.7040625000899693,0.9168455184630628,1.8162901571818761,0.5999255989279065,0.8625744070325579,0.0005690108638024884,4.33979344367981,83.49917721748352
|
| 21 |
+
20,1.3977786842382178,0.7253950468774112,0.9236261788404213,1.835267390523638,0.59375,0.8509672667298999,0.0005597552389540264,4.205085039138794,87.81506681442261
|
| 22 |
+
21,1.352705772755281,0.7402358488091882,0.9320695754492058,1.7370479192052568,0.625297623021262,0.8680059569222587,0.0005493885869400703,4.46692156791687,92.33757758140564
|
| 23 |
+
22,1.2818713463702291,0.7592747638810355,0.9348113205073014,1.7788753935268946,0.623511906181063,0.8677083381584713,0.0005379552993560612,4.306306838989258,96.75121402740479
|
| 24 |
+
23,1.23960036432968,0.7733195750218518,0.941208726392602,1.7448187811034066,0.624479170356478,0.8667410739830562,0.0005255043352947041,4.5156800746917725,101.32582974433899
|
| 25 |
+
24,1.1845267538754445,0.7816214623316279,0.9493160377133567,1.7268592800412859,0.6324404776096344,0.8700892882687705,0.0005120890116956167,4.283179044723511,105.66491198539734
|
| 26 |
+
25,1.1482601896771845,0.8056191037286002,0.9509374999775076,1.6601278696741377,0.6505952392305646,0.8804315498897007,0.000497766775034008,4.492877244949341,110.26761412620544
|
| 27 |
+
26,1.0970904427879262,0.8241332544470733,0.9543278301661869,1.7003263575690133,0.6412202417850494,0.8735863140651158,0.0004825989553260527,4.319522857666016,114.69839429855347
|
| 28 |
+
27,1.0671420963305347,0.8354186320079947,0.9573820750668364,1.7018595508166723,0.6529761935983386,0.8724702426365444,0.00046665050350434655,4.183586597442627,118.93946838378906
|
| 29 |
+
28,1.031318281619054,0.8496521222141554,0.9616745283018868,1.675038184438433,0.6636904776096344,0.8780505997794015,0.00044998971328804097,4.295551538467407,123.34119987487793
|
| 30 |
+
29,0.9810226728331368,0.8620518867699605,0.9685200469673805,1.6946008716310774,0.6522321445601327,0.8734375025544848,0.000432687928738653,4.287081003189087,127.73804664611816
|
| 31 |
+
30,0.9446552553266849,0.873319575246775,0.972435141509434,1.6806286403111048,0.6715029776096344,0.868973216840199,0.00041481923875384165,4.421941757202148,132.21814942359924
|
| 32 |
+
31,0.9062574696990678,0.8850058958215533,0.9735731128251778,1.6571781379835946,0.6695684535162789,0.8857142882687705,0.0003964601598073729,4.355231523513794,136.68097972869873
|
| 33 |
+
32,0.875975528415644,0.8947759433737341,0.9781426882968759,1.676219744341714,0.6537946462631226,0.8813988140651158,0.00037768930829383264,4.424201488494873,141.16294813156128
|
| 34 |
+
33,0.8480666774623798,0.9049469339397719,0.9792158018867925,1.614736897604806,0.6729166678019932,0.884598216840199,0.00035858706388115547,4.277507066726685,145.49760961532593
|
| 35 |
+
34,0.8241101677687663,0.9093926886342606,0.9810082546944888,1.6967434797968184,0.6673363106591361,0.8825148854936872,0.0003392352253125464,4.321351528167725,149.92529940605164
|
| 36 |
+
35,0.7951652874361794,0.9229716979107767,0.9824174524478193,1.6451002699988229,0.6716517891202655,0.8836309569222587,0.00031971666013170435,4.298846483230591,154.29984879493713
|
| 37 |
+
36,0.7897796973867236,0.9249115563788504,0.9811320754716981,1.5879491227013725,0.7044642908232552,0.8914434569222587,0.0003001149498312786,4.1878015995025635,158.5466480255127
|
| 38 |
+
37,0.7547017307776325,0.9346580184855551,0.9864386792452831,1.5644398076193673,0.7065476221697671,0.8925595283508301,0.0002805140319440846,4.339407920837402,162.99805283546448
|
| 39 |
+
38,0.7202602186292972,0.9421580186430013,0.9893455184855551,1.5645637171609061,0.7076636935983386,0.884598216840199,0.00026099784060970316,4.293209552764893,167.40058159828186
|
| 40 |
+
39,0.7178848858149547,0.9443455186654937,0.9865448109383853,1.5728300213813782,0.7033482193946838,0.8903273854936872,0.0002416499471556083,4.404668807983398,171.9102919101715
|
| 41 |
+
40,0.6863401937034895,0.9427889146894779,0.9818278298063098,1.5752366781234741,0.701785717691694,0.901190481015614,0.00022273193218277446,4.306660413742065,176.2750539779663
|
| 42 |
+
41,0.6692139540078506,0.9593808960239842,0.992146226032725,1.6066019790513175,0.6987351221697671,0.8833333381584713,0.00020396459224864252,4.383381366729736,180.71590089797974
|
| 43 |
+
42,0.6645245821970813,0.9614445752692673,0.9917040090515928,1.6104396411350794,0.7005208347524915,0.8833333381584713,0.00018560977532018259,4.447222471237183,185.22099423408508
|
| 44 |
+
43,0.6368075699176429,0.9699292452830188,0.9941037735849056,1.57528498343059,0.7118303605488369,0.8901785739830562,0.00016774607954136533,4.425034999847412,189.705335855484
|
| 45 |
+
44,0.6302758337191816,0.9715094335798947,0.9934728769761212,1.5817997881344386,0.7188244078840528,0.8834821454116276,0.00015045000000000002,4.274783372879028,194.09868836402893
|
| 46 |
+
45,0.6198280639243576,0.971173348854173,0.99465212225914,1.549153012888772,0.7164434535162789,0.8935267882687705,0.00013379560116402527,4.303253173828125,198.50914812088013
|
| 47 |
+
46,0.6119073938648656,0.9744575467874419,0.9936202826364985,1.5453476394925798,0.7274553605488369,0.8911458381584713,0.0001178541997260864,4.3036789894104,202.87154912948608
|
| 48 |
+
47,0.5963564087759774,0.9798054245283019,0.9955778301886793,1.492540955543518,0.7231398820877075,0.9014880997794015,0.00010269405921450936,4.374460220336914,207.35994482040405
|
| 49 |
+
48,0.5920381287358841,0.9819339620617201,0.9956839618817815,1.508758774825505,0.7274553605488369,0.9070684569222587,8.838009767839172e-05,4.406491994857788,211.82676124572754
|
| 50 |
+
49,0.5846751905837149,0.9834492920704607,0.9960200471698113,1.513721261705671,0.7220238106591361,0.8978422667298999,7.49736096985505e-05,4.346835136413574,216.24254250526428
|
| 51 |
+
50,0.5705822098929927,0.9871757075471698,0.9974941037735849,1.509685218334198,0.7231398820877075,0.9013392882687705,6.253200391471685e-05,4.41235089302063,220.71463084220886
|
| 52 |
+
51,0.5749439962630002,0.9852594339622641,0.995872641509434,1.496602211679731,0.7221726221697671,0.902604171207973,5.110855719292715e-05,4.340747833251953,225.1135766506195
|
| 53 |
+
52,0.5656748959478343,0.9865860849056604,0.9979363207547169,1.5063031996999467,0.7209077392305646,0.8979910739830562,4.075218648580371e-05,4.379014492034912,229.55130100250244
|
| 54 |
+
53,0.5562682663494686,0.9911556603773585,0.9983785377358491,1.495346018246242,0.7255208364554814,0.8992559569222587,3.150723936265333e-05,4.352051019668579,233.9833574295044
|
| 55 |
+
54,0.5561487371066831,0.9889445754716981,0.9979363207547169,1.4968839372907365,0.7255208364554814,0.8992559569222587,2.3413304106367364e-05,4.254117012023926,238.29464840888977
|
| 56 |
+
55,0.5539774411129501,0.9898290094339622,0.9974941037735849,1.4940035087721688,0.7276041678019932,0.8992559569222587,1.6505040190316856e-05,4.498452186584473,242.85268831253052
|
| 57 |
+
56,0.5531227881053709,0.9911556603773585,0.9980837264150944,1.4909093465123857,0.7276041678019932,0.8981398854936872,1.0812029861166258e-05,4.329469442367554,247.29466128349304
|
| 58 |
+
57,0.5513924253436754,0.9901886790428521,0.9981898581081966,1.4967533946037292,0.7264880963734218,0.9003720283508301,6.3586514631518396e-06,4.458400011062622,251.81105399131775
|
| 59 |
+
58,0.5483545244864698,0.9911556603773585,0.9988207547169812,1.4977575285094125,0.7264880963734218,0.8992559569222587,3.163975046269028e-06,4.417207479476929,256.2900450229645
|
| 60 |
+
59,0.5524777933111731,0.9908195750893287,0.998337263768574,1.4972110050065177,0.7276041678019932,0.9014880997794015,1.2416807053905374e-06,4.469054460525513,260.81839323043823
|
| 61 |
+
60,0.5435868704094077,0.9821639150943396,0.9895341981132075,1.4968034369604928,0.7287202392305646,0.9014880997794015,6.000571297434275e-07,4.287562847137451,265.1670672893524
|
training_summary.json
ADDED
|
@@ -0,0 +1,11 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"best_epoch": 60,
|
| 3 |
+
"best_val_top1": 0.7287202392305646,
|
| 4 |
+
"final_val_loss": 1.4968034369604928,
|
| 5 |
+
"final_val_top1": 0.7287202392305646,
|
| 6 |
+
"final_val_top5": 0.9014880997794015,
|
| 7 |
+
"total_training_time_sec": 265.57665967941284,
|
| 8 |
+
"total_training_time": "04m 25s",
|
| 9 |
+
"best_checkpoint": "/kaggle/working/asl_transformer_84class_run/best_transformer_asl_84class.pt",
|
| 10 |
+
"last_checkpoint": "/kaggle/working/asl_transformer_84class_run/last_transformer_asl_84class.pt"
|
| 11 |
+
}
|