Text Generation
PEFT
Safetensors
Arabic
English
translation
arabic
dialectal-arabic
nilechat
lora
qlora
back-translation
data-augmentation
alexandriax-2026
arabicnlp2026
shared-task
conversational
Eval Results (legacy)
Instructions to use NAMAA-Space/alexandriax-nilechat-ctx-aux with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use NAMAA-Space/alexandriax-nilechat-ctx-aux with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("UBC-NLP/NileChat-3B-Base") model = PeftModel.from_pretrained(base_model, "NAMAA-Space/alexandriax-nilechat-ctx-aux") - Notebooks
- Google Colab
- Kaggle
Point all references at NAMAA-Space; document the fixed tokenizer and a version-robust loader
Browse files- train_nilechat_qlora.py +3 -3
train_nilechat_qlora.py
CHANGED
|
@@ -9,12 +9,12 @@ as the organisers' official baseline) for English -> dialectal Arabic dialogue t
|
|
| 9 |
One script, three variants - the ablation this pair of repos exists to document:
|
| 10 |
|
| 11 |
--variant noctx the prompt's history block is always "No previous turns"
|
| 12 |
-
->
|
| 13 |
dev 23.54 spBLEU / 39.68 chrF++ (BEST of the three)
|
| 14 |
--variant ctx the model's own previous turns are fed back as history
|
| 15 |
-> not released; dev 22.87 / 39.11
|
| 16 |
--variant ctx_aux ctx + 348,787 back-translated pairs
|
| 17 |
-
->
|
| 18 |
dev 22.77 / 38.71
|
| 19 |
|
| 20 |
"dev" is the official 12,250-turn AlexandriaX development set, country-macro spBLEU
|
|
@@ -57,7 +57,7 @@ from trl import SFTConfig, SFTTrainer
|
|
| 57 |
# --------------------------------------------------------------------------------------
|
| 58 |
MODEL_NAME = "UBC-NLP/NileChat-3B-Base"
|
| 59 |
DATASET = "UBC-NLP/alexandria"
|
| 60 |
-
AUX_DATASET = "
|
| 61 |
|
| 62 |
MAX_SEQ_LENGTH = 1024
|
| 63 |
MAX_NEW_TOKENS = 128
|
|
|
|
| 9 |
One script, three variants - the ablation this pair of repos exists to document:
|
| 10 |
|
| 11 |
--variant noctx the prompt's history block is always "No previous turns"
|
| 12 |
+
-> NAMAA-Space/alexandriax-nilechat-lora
|
| 13 |
dev 23.54 spBLEU / 39.68 chrF++ (BEST of the three)
|
| 14 |
--variant ctx the model's own previous turns are fed back as history
|
| 15 |
-> not released; dev 22.87 / 39.11
|
| 16 |
--variant ctx_aux ctx + 348,787 back-translated pairs
|
| 17 |
+
-> NAMAA-Space/alexandriax-nilechat-ctx-aux
|
| 18 |
dev 22.77 / 38.71
|
| 19 |
|
| 20 |
"dev" is the official 12,250-turn AlexandriaX development set, country-macro spBLEU
|
|
|
|
| 57 |
# --------------------------------------------------------------------------------------
|
| 58 |
MODEL_NAME = "UBC-NLP/NileChat-3B-Base"
|
| 59 |
DATASET = "UBC-NLP/alexandria"
|
| 60 |
+
AUX_DATASET = "NAMAA-Space/alexandria-backtranslated-pairs" # 348,787 synthetic pairs
|
| 61 |
|
| 62 |
MAX_SEQ_LENGTH = 1024
|
| 63 |
MAX_NEW_TOKENS = 128
|