Nexuss0781
/

Ethio-BBPE

Model card Files Files and versions

Commit History

Upload folder using huggingface_hub

facc1cb
verified

Nexuss0781 commited on May 5

Upload README.md with huggingface_hub

cd24241
verified

Nexuss0781 commited on May 5

Upload folder using huggingface_hub

b1e0113
verified

Nexuss0781 commited on May 5

Delete vocab.json with huggingface_hub

b67ed7c
verified

Nexuss0781 commited on May 2

Delete scripts/prepare_datasets.py with huggingface_hub

b9207bc
verified

Nexuss0781 commited on May 2

Delete run_training.sh with huggingface_hub

12ddbd6
verified

Nexuss0781 commited on May 2

Delete test_amharic.py with huggingface_hub

899d165
verified

Nexuss0781 commited on May 2

Delete SETUP_COMPLETE.md with huggingface_hub

ca81273
verified

Nexuss0781 commited on May 2

Delete models/demo_tokenizer/vocab.json with huggingface_hub

1f56d4b
verified

Nexuss0781 commited on May 2

Delete models/demo_tokenizer/tokenizer.json with huggingface_hub

3c38dcf
verified

Nexuss0781 commited on May 2

Delete models/demo_tokenizer/merges.txt with huggingface_hub

bfaa93b
verified

Nexuss0781 commited on May 2

Delete models/demo_tokenizer/config.json with huggingface_hub

49b7577
verified

Nexuss0781 commited on May 2

Delete models/demo_tokenizer/README.md with huggingface_hub

473388d
verified

Nexuss0781 commited on May 2

Delete data/sample_corpus.txt with huggingface_hub

a4dfab3
verified

Nexuss0781 commited on May 2

Delete training_corpus.txt with huggingface_hub

b439fdc
verified

Nexuss0781 commited on May 2

Delete synaxarium_dataset.parquet with huggingface_hub

9a7924e
verified

Nexuss0781 commited on May 2

Delete canon_biblical_am_en.parquet with huggingface_hub

96db246
verified

Nexuss0781 commited on May 2

Upload README.md with huggingface_hub

6bee0b6
verified

Nexuss0781 commited on May 2

Upload README.md with huggingface_hub

11d54a0
verified

Nexuss0781 commited on May 2

Upload pyproject.toml with huggingface_hub

2a4e3ee
verified

Nexuss0781 commited on May 2

Upload vocab.json.gz with huggingface_hub

42710a3
verified

Nexuss0781 commited on May 2

Upload scripts/prepare_data.py with huggingface_hub

9b9e393
verified

Nexuss0781 commited on May 1

Upload scripts/train_tokenizer.py with huggingface_hub

80f2516
verified

Nexuss0781 commited on May 1

Upload scripts/bbpe_trainer.py with huggingface_hub

5f75c0c
verified

Nexuss0781 commited on May 1

Upload training_corpus.txt with huggingface_hub

37f6a3b
verified

Nexuss0781 commited on May 1

Upload canon_biblical_am_en.parquet with huggingface_hub

8fb9eb9
verified

Nexuss0781 commited on May 1

Upload synaxarium_dataset.parquet with huggingface_hub

b2c9936
verified

Nexuss0781 commited on May 1

Production release: EthioBBPE tokenizer with perfect Amharic reconstruction

af2f42f
verified

Nexuss0781 commited on May 1

Upload models/vocab.json.gz with huggingface_hub

ac27e9e
verified

Nexuss0781 commited on May 1

Upload models/training_metrics.json with huggingface_hub

8b05a3f
verified

Nexuss0781 commited on May 1

Upload models/tokenizer.json with huggingface_hub

61daede
verified

Nexuss0781 commited on May 1

Upload models/special_tokens_map.json with huggingface_hub

e638f86
verified

Nexuss0781 commited on May 1

Upload models/config.json with huggingface_hub

a0995a7
verified

Nexuss0781 commited on May 1

Upload models/README.md with huggingface_hub

e7a5974
verified

Nexuss0781 commited on May 1

Upload test_amharic.py with huggingface_hub

4951c0d
verified

Nexuss0781 commited on May 1

Upload run_training.sh with huggingface_hub

b43566f
verified

Nexuss0781 commited on May 1

Upload .gitignore with huggingface_hub

160c09f
verified

Nexuss0781 commited on May 1

Upload SETUP_COMPLETE.md with huggingface_hub

fb3b54d
verified

Nexuss0781 commited on May 1

Upload README.md with huggingface_hub

df867d1
verified

Nexuss0781 commited on May 1

Upload scripts/prepare_datasets.py with huggingface_hub

c85edbb
verified

Nexuss0781 commited on May 1

Upload scripts/train_tokenizer.py with huggingface_hub

bbb716d
verified

Nexuss0781 commited on May 1

Upload scripts/bbpe_trainer.py with huggingface_hub

6611338
verified

Nexuss0781 commited on May 1

Upload vocab.json.gz with huggingface_hub

9a825bb
verified

Nexuss0781 commited on May 1

Upload training_metrics.json with huggingface_hub

86419a2
verified

Nexuss0781 commited on May 1

Upload tokenizer.json with huggingface_hub

01c8cd2
verified

Nexuss0781 commited on May 1

Upload special_tokens_map.json with huggingface_hub

b0f8146
verified

Nexuss0781 commited on May 1

Upload config.json with huggingface_hub

cca3eb7
verified

Nexuss0781 commited on May 1

Upload README.md with huggingface_hub

0344dd8
verified

Nexuss0781 commited on May 1

Final production release: checkpointing, compression, and perfect Amharic reconstruction metrics

b030bfb
verified

Nexuss0781 commited on May 1

Upload README.md with huggingface_hub

36fa7c5
verified

Nexuss0781 commited on May 1