Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Website
Tasks
HuggingChat
Collections
Languages
Organizations
Community
Blog
Posts
Daily Papers
Hardware
Learn
Discord
Forum
GitHub
Solutions
Team & Enterprise
Hugging Face PRO
Enterprise Support
Inference Providers
Inference Endpoints
Storage Buckets
Log In
Sign Up
timothydillan
/
oim-script-equitable-regional-sp-bpe-32k-native-weighted-v0
like
0
6 languages
tokenizers
tokenizer
indonesian
regional-languages
low-resource-languages
sentencepiece
script-equitable
native-script
aksara
native-weighted
License:
other
Model card
Files
Files and versions
xet
Community
Copy to bucket
new
main
oim-script-equitable-regional-sp-bpe-32k-native-weighted-v0
1.31 MB
Ctrl+K
Ctrl+K
1 contributor
History:
8 commits
timothydillan
Update v0 public manifest metadata
e35e1ea
verified
12 days ago
benchmarks
Upload benchmarks/gemma_baseline_summary.md with huggingface_hub
12 days ago
provenance
Upload native-weighted script-equitable tokenizer v0
12 days ago
.gitattributes
Safe
1.52 kB
initial commit
12 days ago
MANIFEST.json
2.82 kB
Update v0 public manifest metadata
12 days ago
README.md
6.39 kB
Public v0: add Gemma baseline headline, provenance/licensing, fix file list
12 days ago
oim-script-equitable-regional-v0-native-weighted-32k-sp-bpe.model
756 kB
xet
Upload native-weighted script-equitable tokenizer v0
12 days ago
oim-script-equitable-regional-v0-native-weighted-32k-sp-bpe.vocab
473 kB
Upload native-weighted script-equitable tokenizer v0
12 days ago