pumad commited on
Commit
28c5765
·
verified ·
1 Parent(s): ad98cd5

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +117 -8
README.md CHANGED
@@ -1,11 +1,120 @@
1
  ---
2
- license: mit
3
- datasets:
4
- - Helsinki-NLP/europarl
5
  language:
6
- - de
7
- - en
8
  tags:
9
- - LOCALIZATION
10
- - NMT
11
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ license: apache-2.0
 
 
3
  language:
4
+ - en
5
+ - de
6
  tags:
7
+ - translation
8
+ - marian
9
+ - nmt
10
+ - encoder-decoder
11
+ pipeline_tag: translation
12
+ widget:
13
+ - text: "The weather is beautiful today."
14
+ example_title: "Simple sentence"
15
+ - text: "Machine learning is transforming the way we build software applications."
16
+ example_title: "Technical text"
17
+ - text: "The European Union has proposed new regulations on artificial intelligence."
18
+ example_title: "Formal text"
19
+ datasets:
20
+ - opus100
21
+ - europarl_bilingual
22
+ - un_pc
23
+ model-index:
24
+ - name: pumadic-en-de
25
+ results: []
26
+ ---
27
+
28
+ # Pumatic English-German Translation Model
29
+
30
+ A neural machine translation model for English to German translation built with the MarianMT architecture.
31
+
32
+ ## Model Description
33
+
34
+ - **Model type:** Encoder-Decoder (MarianMT architecture)
35
+ - **Language pair:** English → German
36
+ - **Parameters:** ~74.7M
37
+ - **GPU:** H100
38
+ - **Trained by:** [pumad](https://huggingface.co/pumad)
39
+
40
+ ## Training Details
41
+
42
+ ### Training Data
43
+
44
+ The model was trained on high-quality parallel corpora:
45
+ - **OPUS-100** - Multilingual parallel corpus
46
+ - **Europarl** - European Parliament proceedings
47
+ - **UN Parallel Corpus (UNPC)** - United Nations documents
48
+
49
+ ### Training Procedure
50
+
51
+ - **Hardware:** NVIDIA H100 GPU
52
+ - **Framework:** Hugging Face Transformers
53
+ - **Batch size:** 128
54
+ - **Learning rate:** 2e-5
55
+ - **Epochs:** 1 (fine-tuning)
56
+ - **Max sequence length:** 128 tokens
57
+
58
+ ### Data Preprocessing
59
+
60
+ - Quality filtering: Removed pairs with fewer than 5 words or more than 200 words
61
+ - Length ratio filtering: Excluded pairs with extreme length ratios (< 0.5 or > 2.0)
62
+ - Deduplication: Removed duplicate source sentences
63
+
64
+ ## Usage
65
+
66
+ ### Using the Transformers library
67
+
68
+ ```python
69
+ from transformers import MarianMTModel, MarianTokenizer
70
+
71
+ model_name = "pumad/pumadic-en-de"
72
+ tokenizer = MarianTokenizer.from_pretrained(model_name)
73
+ model = MarianMTModel.from_pretrained(model_name)
74
+
75
+ text = "Hello, how are you today?"
76
+ inputs = tokenizer(text, return_tensors="pt", padding=True)
77
+ translated = model.generate(**inputs)
78
+ output = tokenizer.decode(translated[0], skip_special_tokens=True)
79
+ print(output)
80
+ ```
81
+
82
+ ### Using the Pipeline API
83
+
84
+ ```python
85
+ from transformers import pipeline
86
+
87
+ translator = pipeline("translation", model="pumad/pumadic-en-de")
88
+ result = translator("The quick brown fox jumps over the lazy dog.")
89
+ print(result[0]['translation_text'])
90
+ ```
91
+
92
+ ## Demo
93
+
94
+ Try this model live at [pumatic.eu](https://pumatic.eu)
95
+
96
+ API documentation available at [pumatic.eu/docs](https://pumatic.eu/docs)
97
+
98
+ ## Limitations
99
+
100
+ - Optimized for general-purpose translation; domain-specific terminology may vary in quality
101
+ - Maximum input length of ~400 characters per chunk for optimal results
102
+ - Best performance on formal/written text; colloquial expressions may be less accurate
103
+
104
+ ## License
105
+
106
+ Apache 2.0
107
+
108
+ ## Citation
109
+
110
+ If you use this model, please cite:
111
+
112
+ ```bibtex
113
+ @misc{pumatic-en-de,
114
+ author = {pumad},
115
+ title = {Pumatic English-German Translation Model},
116
+ year = {2025},
117
+ publisher = {Hugging Face},
118
+ url = {https://huggingface.co/pumad/pumadic-en-de}
119
+ }
120
+ ```