Upload pyproject.toml with huggingface_hub

Upload vocab.json.gz with huggingface_hub

Upload scripts/prepare_data.py with huggingface_hub

Upload scripts/train_tokenizer.py with huggingface_hub

Upload scripts/bbpe_trainer.py with huggingface_hub

Upload training_corpus.txt with huggingface_hub

Upload canon_biblical_am_en.parquet with huggingface_hub

Upload synaxarium_dataset.parquet with huggingface_hub

Production release: EthioBBPE tokenizer with perfect Amharic reconstruction

Upload models/vocab.json.gz with huggingface_hub

Upload models/training_metrics.json with huggingface_hub

Upload models/tokenizer.json with huggingface_hub

Upload models/special_tokens_map.json with huggingface_hub

Upload models/config.json with huggingface_hub

Upload models/README.md with huggingface_hub

Upload test_amharic.py with huggingface_hub

Upload run_training.sh with huggingface_hub

Upload .gitignore with huggingface_hub

Upload SETUP_COMPLETE.md with huggingface_hub

Upload README.md with huggingface_hub

Upload scripts/prepare_datasets.py with huggingface_hub

Upload scripts/train_tokenizer.py with huggingface_hub

Upload scripts/bbpe_trainer.py with huggingface_hub

Upload vocab.json.gz with huggingface_hub

Upload training_metrics.json with huggingface_hub

Upload tokenizer.json with huggingface_hub

Upload special_tokens_map.json with huggingface_hub

Upload config.json with huggingface_hub

Upload README.md with huggingface_hub

Final production release: checkpointing, compression, and perfect Amharic reconstruction metrics

Upload README.md with huggingface_hub

Upload folder using huggingface_hub

Upload README.md with huggingface_hub

Upload folder using huggingface_hub

Upload config.json with huggingface_hub

Upload merges.txt with huggingface_hub

Upload vocab.json with huggingface_hub

Upload tokenizer.json with huggingface_hub

Upload README.md with huggingface_hub

Upload folder using huggingface_hub

feat: Initial release of EthioBBPE - Ethiopian Language Tokenizer

initial commit