FatimahEmadEldin commited on
Commit
f9c6f07
·
verified ·
1 Parent(s): 1699280

Point all references at NAMAA-Space; document the fixed tokenizer and a version-robust loader

Browse files
Files changed (1) hide show
  1. train_nilechat_qlora.py +3 -3
train_nilechat_qlora.py CHANGED
@@ -9,12 +9,12 @@ as the organisers' official baseline) for English -> dialectal Arabic dialogue t
9
  One script, three variants - the ablation this pair of repos exists to document:
10
 
11
  --variant noctx the prompt's history block is always "No previous turns"
12
- -> FatimahEmadEldin/alexandriax-nilechat-lora
13
  dev 23.54 spBLEU / 39.68 chrF++ (BEST of the three)
14
  --variant ctx the model's own previous turns are fed back as history
15
  -> not released; dev 22.87 / 39.11
16
  --variant ctx_aux ctx + 348,787 back-translated pairs
17
- -> FatimahEmadEldin/alexandriax-nilechat-ctx-aux
18
  dev 22.77 / 38.71
19
 
20
  "dev" is the official 12,250-turn AlexandriaX development set, country-macro spBLEU
@@ -57,7 +57,7 @@ from trl import SFTConfig, SFTTrainer
57
  # --------------------------------------------------------------------------------------
58
  MODEL_NAME = "UBC-NLP/NileChat-3B-Base"
59
  DATASET = "UBC-NLP/alexandria"
60
- AUX_DATASET = "FatimahEmadEldin/alexandria-backtranslated-pairs" # 348,787 synthetic pairs
61
 
62
  MAX_SEQ_LENGTH = 1024
63
  MAX_NEW_TOKENS = 128
 
9
  One script, three variants - the ablation this pair of repos exists to document:
10
 
11
  --variant noctx the prompt's history block is always "No previous turns"
12
+ -> NAMAA-Space/alexandriax-nilechat-lora
13
  dev 23.54 spBLEU / 39.68 chrF++ (BEST of the three)
14
  --variant ctx the model's own previous turns are fed back as history
15
  -> not released; dev 22.87 / 39.11
16
  --variant ctx_aux ctx + 348,787 back-translated pairs
17
+ -> NAMAA-Space/alexandriax-nilechat-ctx-aux
18
  dev 22.77 / 38.71
19
 
20
  "dev" is the official 12,250-turn AlexandriaX development set, country-macro spBLEU
 
57
  # --------------------------------------------------------------------------------------
58
  MODEL_NAME = "UBC-NLP/NileChat-3B-Base"
59
  DATASET = "UBC-NLP/alexandria"
60
+ AUX_DATASET = "NAMAA-Space/alexandria-backtranslated-pairs" # 348,787 synthetic pairs
61
 
62
  MAX_SEQ_LENGTH = 1024
63
  MAX_NEW_TOKENS = 128