Models
Datasets
Spaces
Buckets new
Docs
Enterprise
Pricing
- Website
- Community
- Solutions
Log In
Sign Up

diabolic6045
/

Sanskrit-English-qwen2-tokenizer

Text Generation

Model card Files Files and versions

Sanskrit-English-qwen2-tokenizer

11.3 MB

Ctrl+K

Ctrl+K

2 contributors

History: 7 commits

Avinyaa

updated tokenizer

81f3642 8 months ago

.gitattributes

1.57 kB
Upload folder using huggingface_hub 8 months ago
README.md

2.92 kB
Update README.md 8 months ago
TECHNICAL_README.md

10.7 kB
Update TECHNICAL_README.md 8 months ago
config.json

522 Bytes
updated tokenizer 8 months ago
special_tokens_map.json

80 Bytes
updated tokenizer 8 months ago
tokenizer.json

11.3 MB
xet

updated tokenizer 8 months ago
tokenizer_config.json

3.77 kB
updated tokenizer 8 months ago
train_tokenizer.py

4.6 kB
updated tokenizer 8 months ago