drelhaj commited on
Commit
780d07b
·
verified ·
1 Parent(s): 457e7e8

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +96 -96
README.md CHANGED
@@ -1,97 +1,97 @@
1
- ---
2
- license: apache-2.0
3
- base_model: Helsinki-NLP/opus-mt-en-ar
4
- tags:
5
- - machine-translation
6
- - marian
7
- - mcwc
8
- - legal-nlp
9
- - constitutional-texts
10
- - generated_from_keras_callback
11
- model-index:
12
- - name: marian-finetuned-mcwc-en-to-ar
13
- results: []
14
- ---
15
-
16
- # Marian MT fine-tuned on the Multilingual Corpus of World’s Constitutions (MCWC)
17
- This model is a fine-tuned version of [Helsinki-NLP/opus-mt-es-en](https://huggingface.co/Helsinki-NLP/opus-mt-es-en), adapted using high-quality sentence-aligned constitutional text from the **Multilingual Corpus of World’s Constitutions (MCWC)**
18
- 📄 MCWC paper (OSACT 2024): https://aclanthology.org/2024.osact-1.7/
19
-
20
- **This variant handles: _English → Arabic_ translation.**
21
-
22
- ---
23
-
24
- ## Overview
25
- The MCWC provides a curated multilingual collection of constitutional texts from countries across the world. The corpus emphasises data cleanliness, high-quality sentence alignment, and detailed metadata (including country and continent mappings). It supports research in:
26
-
27
- - legal and constitutional NLP
28
- - comparative constitutional studies
29
- - multilingual machine translation
30
- - cross-lingual semantic analysis
31
-
32
- This model was fine-tuned on the English–Arabic segment of the MCWC, enabling translation that is more attuned to legal and constitutional language than general-purpose MT systems.
33
-
34
- ---
35
-
36
- ## Intended use
37
- This model is suitable for tasks such as:
38
-
39
- - translating constitutional or legal documents
40
- - cross-lingual legal text comparison
41
- - multilingual information extraction
42
- - downstream legal NLP tasks requiring domain-specific MT
43
-
44
- It is **not** intended for casual or conversational translation, as it is optimised for formal and legal text.
45
-
46
- ---
47
-
48
- ## Training data
49
- The model was trained on the MCWC’s English–Arabic aligned sentence pairs.
50
- The MCWC dataset includes:
51
-
52
- - cleaned constitutional text
53
- - high-quality sentence segmentation
54
- - pairwise alignments
55
- - country and regional metadata
56
-
57
- More details may be found in the accompanying paper:
58
- > *El-Haj, M. & Ezzini, S. (2024). “The Multilingual Corpus of World’s Constitutions (MCWC).”*
59
- > OSACT @ LREC-COLING 2024.
60
- > https://aclanthology.org/2024.osact-1.7/
61
-
62
- ---
63
-
64
- ## Training procedure
65
-
66
- ### Training hyperparameters
67
-
68
- The following hyperparameters were used during training:
69
- - optimizer: {'name': 'AdamWeightDecay', 'learning_rate': {'module': 'keras.optimizers.schedules', 'class_name': 'PolynomialDecay', 'config': {'initial_learning_rate': 5e-05, 'decay_steps': 3912, 'end_learning_rate': 0.0, 'power': 1.0, 'cycle': False, 'name': None}, 'registered_name': None}, 'decay': 0.0, 'beta_1': 0.9, 'beta_2': 0.999, 'epsilon': 1e-08, 'amsgrad': False, 'weight_decay_rate': 0.01}
70
- - training_precision: mixed_float16
71
-
72
- ### Training results
73
-
74
- | Train Loss | Validation Loss | Epoch |
75
- |:----------:|:---------------:|:-----:|
76
- | 1.8177 | 1.6380 | 0 |
77
- | 1.5158 | 1.5928 | 1 |
78
- | 1.3738 | 1.5802 | 2 |
79
-
80
-
81
- ### Framework versions
82
-
83
- - Transformers 4.33.3
84
- - TensorFlow 2.13.0
85
- - Datasets 2.14.5
86
- - Tokenizers 0.13.3
87
-
88
- ---
89
-
90
- ## Citation
91
-
92
- If you use this model, please cite the MCWC paper:
93
-
94
- **El-Haj, M. & Ezzini, S. (2024).**
95
- *The Multilingual Corpus of World’s Constitutions (MCWC).*
96
- Proceedings of OSACT @ LREC-COLING 2024.
97
  https://aclanthology.org/2024.osact-1.7/
 
1
+ ---
2
+ license: apache-2.0
3
+ base_model: Helsinki-NLP/opus-mt-en-ar
4
+ tags:
5
+ - machine-translation
6
+ - marian
7
+ - mcwc
8
+ - legal-nlp
9
+ - constitutional-texts
10
+ - generated_from_keras_callback
11
+ model-index:
12
+ - name: marian-finetuned-mcwc-en-to-ar
13
+ results: []
14
+ ---
15
+
16
+ # Marian MT fine-tuned on the Multilingual Corpus of World’s Constitutions (MCWC)
17
+ This model is a fine-tuned version of [Helsinki-NLP/opus-mt-en-ar](https://huggingface.co/Helsinki-NLP/opus-mt-en-ar), adapted using high-quality sentence-aligned constitutional text from the **Multilingual Corpus of World’s Constitutions (MCWC)**
18
+ 📄 MCWC paper (OSACT 2024): https://aclanthology.org/2024.osact-1.7/
19
+
20
+ **This variant handles: _English → Arabic_ translation.**
21
+
22
+ ---
23
+
24
+ ## Overview
25
+ The MCWC provides a curated multilingual collection of constitutional texts from countries across the world. The corpus emphasises data cleanliness, high-quality sentence alignment, and detailed metadata (including country and continent mappings). It supports research in:
26
+
27
+ - legal and constitutional NLP
28
+ - comparative constitutional studies
29
+ - multilingual machine translation
30
+ - cross-lingual semantic analysis
31
+
32
+ This model was fine-tuned on the English–Arabic segment of the MCWC, enabling translation that is more attuned to legal and constitutional language than general-purpose MT systems.
33
+
34
+ ---
35
+
36
+ ## Intended use
37
+ This model is suitable for tasks such as:
38
+
39
+ - translating constitutional or legal documents
40
+ - cross-lingual legal text comparison
41
+ - multilingual information extraction
42
+ - downstream legal NLP tasks requiring domain-specific MT
43
+
44
+ It is **not** intended for casual or conversational translation, as it is optimised for formal and legal text.
45
+
46
+ ---
47
+
48
+ ## Training data
49
+ The model was trained on the MCWC’s English–Arabic aligned sentence pairs.
50
+ The MCWC dataset includes:
51
+
52
+ - cleaned constitutional text
53
+ - high-quality sentence segmentation
54
+ - pairwise alignments
55
+ - country and regional metadata
56
+
57
+ More details may be found in the accompanying paper:
58
+ > *El-Haj, M. & Ezzini, S. (2024). “The Multilingual Corpus of World’s Constitutions (MCWC).”*
59
+ > OSACT @ LREC-COLING 2024.
60
+ > https://aclanthology.org/2024.osact-1.7/
61
+
62
+ ---
63
+
64
+ ## Training procedure
65
+
66
+ ### Training hyperparameters
67
+
68
+ The following hyperparameters were used during training:
69
+ - optimizer: {'name': 'AdamWeightDecay', 'learning_rate': {'module': 'keras.optimizers.schedules', 'class_name': 'PolynomialDecay', 'config': {'initial_learning_rate': 5e-05, 'decay_steps': 3912, 'end_learning_rate': 0.0, 'power': 1.0, 'cycle': False, 'name': None}, 'registered_name': None}, 'decay': 0.0, 'beta_1': 0.9, 'beta_2': 0.999, 'epsilon': 1e-08, 'amsgrad': False, 'weight_decay_rate': 0.01}
70
+ - training_precision: mixed_float16
71
+
72
+ ### Training results
73
+
74
+ | Train Loss | Validation Loss | Epoch |
75
+ |:----------:|:---------------:|:-----:|
76
+ | 1.8177 | 1.6380 | 0 |
77
+ | 1.5158 | 1.5928 | 1 |
78
+ | 1.3738 | 1.5802 | 2 |
79
+
80
+
81
+ ### Framework versions
82
+
83
+ - Transformers 4.33.3
84
+ - TensorFlow 2.13.0
85
+ - Datasets 2.14.5
86
+ - Tokenizers 0.13.3
87
+
88
+ ---
89
+
90
+ ## Citation
91
+
92
+ If you use this model, please cite the MCWC paper:
93
+
94
+ **El-Haj, M. & Ezzini, S. (2024).**
95
+ *The Multilingual Corpus of World’s Constitutions (MCWC).*
96
+ Proceedings of OSACT @ LREC-COLING 2024.
97
  https://aclanthology.org/2024.osact-1.7/