Nexuss0781
/

Ethio-BBPE

Model card Files Files and versions

Ctrl+K

Ctrl+K

1 contributor

History: 14 commits

Nexuss0781's picture

Upload README.md with huggingface_hub

0344dd8 verified 3 months ago

data
feat: Initial release of EthioBBPE - Ethiopian Language Tokenizer 3 months ago
models
Upload folder using huggingface_hub 3 months ago
scripts
Upload folder using huggingface_hub 3 months ago
.gitattributes

1.52 kB
initial commit 3 months ago
.gitignore

449 Bytes
Upload folder using huggingface_hub 3 months ago
LICENSE

1.09 kB
feat: Initial release of EthioBBPE - Ethiopian Language Tokenizer 3 months ago
README.md

2.32 kB
Upload README.md with huggingface_hub 3 months ago
config.json

434 Bytes
Final production release: checkpointing, compression, and perfect Amharic reconstruction metrics 3 months ago
merges.txt

2.11 kB
Upload merges.txt with huggingface_hub 3 months ago
requirements.txt

19 Bytes
feat: Initial release of EthioBBPE - Ethiopian Language Tokenizer 3 months ago
tokenizer.json

2.88 MB
Final production release: checkpointing, compression, and perfect Amharic reconstruction metrics 3 months ago
training_metrics.json

161 Bytes
Final production release: checkpointing, compression, and perfect Amharic reconstruction metrics 3 months ago
vocab.json

5.9 kB
Upload vocab.json with huggingface_hub 3 months ago
vocab.json.gz

300 kB
xet

Final production release: checkpointing, compression, and perfect Amharic reconstruction metrics 3 months ago