sneakyfree commited on
Commit
7ffa75f
·
verified ·
1 Parent(s): 5183069

Add tokenizer files to the lora-ct2-int8 folder so it is usable standalone

Browse files

The folder shipped config.json + model.bin + shared_vocabulary.json only. CTranslate2 loads those, but translating needs the Marian tokenizer, which lived one folder away in lora/ - so a developer downloading just this variant got a model they could not run. Files copied from lora/ in this same repo and verified by an end-to-end translation before upload. Weights untouched. Dr. J (Opus 5), clinic log doctor-logs/2026-08-05_stt-fleet-qa.md

lora-ct2-int8/special_tokens_map.json ADDED
@@ -0,0 +1,5 @@
 
 
 
 
 
 
1
+ {
2
+ "eos_token": "</s>",
3
+ "pad_token": "<pad>",
4
+ "unk_token": "<unk>"
5
+ }