KonradBRG commited on
Commit
dd18ab9
·
verified ·
1 Parent(s): e3aa012

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +26 -51
README.md CHANGED
@@ -1,70 +1,45 @@
1
  ---
2
- library_name: transformers
 
 
 
 
3
  tags:
4
- - generated_from_trainer
5
- model-index:
6
- - name: xlm-mlm-alpha-0p15-plains-cree-en-calibrated
7
- results: []
 
 
8
  ---
9
 
10
- <!-- This model card has been generated automatically according to the information the Trainer had access to. You
11
- should probably proofread and complete it, then remove this comment. -->
12
-
13
  # xlm-mlm-alpha-0p15-plains-cree-en-calibrated
14
 
15
- This model was trained from scratch on an unknown dataset.
16
- It achieves the following results on the evaluation set:
17
- - Loss: 5.4477
18
- - Macro F1: 0.4514
19
- - Literal F1: 0.8056
20
- - Idiom F1: 0.25
21
- - Metaphor F1: 0.0
22
- - Simile F1: 0.75
23
-
24
- ## Model description
25
 
26
- More information needed
27
 
28
- ## Intended uses & limitations
29
 
30
- More information needed
 
 
31
 
32
- ## Training and evaluation data
33
 
34
- More information needed
35
 
36
- ## Training procedure
37
 
38
- ### Training hyperparameters
39
 
40
- The following hyperparameters were used during training:
41
- - learning_rate: 5e-06
42
- - train_batch_size: 8
43
- - eval_batch_size: 16
44
- - seed: 42
45
- - optimizer: Use OptimizerNames.ADAMW_TORCH_FUSED with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
46
- - lr_scheduler_type: linear
47
- - lr_scheduler_warmup_steps: 0.1
48
- - num_epochs: 15
49
 
50
- ### Training results
51
 
52
- | Training Loss | Epoch | Step | Validation Loss | Macro F1 | Literal F1 | Idiom F1 | Metaphor F1 | Simile F1 |
53
- |:-------------:|:-----:|:----:|:---------------:|:--------:|:----------:|:--------:|:-----------:|:---------:|
54
- | 1.8099 | 1.0 | 24 | 1.8060 | 0.2194 | 0.6957 | 0.1818 | 0.0 | 0.0 |
55
- | 1.0587 | 2.0 | 48 | 1.5870 | 0.4166 | 0.7164 | 0.2 | 0.0 | 0.75 |
56
- | 0.5081 | 3.0 | 72 | 1.7403 | 0.4481 | 0.7353 | 0.2 | 0.0 | 0.8571 |
57
- | 0.4727 | 4.0 | 96 | 2.6182 | 0.4615 | 0.7887 | 0.2 | 0.0 | 0.8571 |
58
- | 0.1802 | 5.0 | 120 | 3.6535 | 0.4569 | 0.7887 | 0.1818 | 0.0 | 0.8571 |
59
- | 0.2120 | 6.0 | 144 | 4.2568 | 0.4712 | 0.8056 | 0.2222 | 0.0 | 0.8571 |
60
- | 0.0492 | 7.0 | 168 | 4.6632 | 0.4514 | 0.8056 | 0.25 | 0.0 | 0.75 |
61
- | 0.0244 | 8.0 | 192 | 5.1437 | 0.4514 | 0.8056 | 0.25 | 0.0 | 0.75 |
62
- | 0.0005 | 9.0 | 216 | 5.4477 | 0.4514 | 0.8056 | 0.25 | 0.0 | 0.75 |
63
 
 
64
 
65
- ### Framework versions
 
 
66
 
67
- - Transformers 5.12.1
68
- - Pytorch 2.12.1+cu130
69
- - Datasets 5.0.0
70
- - Tokenizers 0.22.2
 
1
  ---
2
+ base_model: FacebookAI/xlm-mlm-100-1280
3
+ language:
4
+ - crk
5
+ license: cc-by-4.0
6
+ pipeline_tag: text-classification
7
  tags:
8
+ - figurative-language
9
+ - text-classification
10
+ - plains-cree
11
+ - clkd
12
+ - low-resource
13
+ - calibrated
14
  ---
15
 
 
 
 
16
  # xlm-mlm-alpha-0p15-plains-cree-en-calibrated
17
 
18
+ FacebookAI/xlm-mlm-100-1280 calibrated on DeepSeek-annotated Bloomfield Plains Cree sentences for figurative language detection.
 
 
 
 
 
 
 
 
 
19
 
20
+ ## Training
21
 
22
+ Low-LR calibration of a CLKD checkpoint on gold/silver Bloomfield validation data (all DeepSeek-annotated sentences).
23
 
24
+ **Base checkpoint:** `data/clkd_xlm-mlm-alpha-0p15`
25
+ **Literal : figurative ratio:** 3:1 | **Epochs:** 15 | **Learning rate:** 5e-06
26
+ **Hardware:** 1× NVIDIA A100 40 GB
27
 
28
+ **Labels:** `literal` (0), `idiom` (1), `metaphor` (2), `simile` (3)
29
 
30
+ ## Intended use
31
 
32
+ Final deployed checkpoint for figurative language detection in Plains Cree.
33
 
 
34
 
35
+ ## Citation
 
 
 
 
 
 
 
 
36
 
37
+ If you use this model, please cite the associated thesis/paper (TBD).
38
 
 
 
 
 
 
 
 
 
 
 
 
39
 
40
+ ## Data
41
 
42
+ Training data includes:
43
+ - [Bloomfield (1934) *Plains Cree Texts*](https://bloomfield.kiyanaw.net) (scraped and sentence-aligned)
44
+ - [EdTeKLA Indigenous Languages Corpora](https://github.com/EdTeKLA/IndigenousLanguages_Corpora)
45