Text Generation
fastText
Toki Pona
wikilangs
nlp
tokenizer
embeddings
n-gram
markov
wikipedia
feature-extraction
sentence-similarity
tokenization
n-grams
markov-chain
text-mining
babelvec
vocabulous
vocabulary
monolingual
family-constructed_auxlang
Instructions to use wikilangs/tok with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- fastText
How to use wikilangs/tok with fastText:
from huggingface_hub import hf_hub_download import fasttext model = fasttext.load_model(hf_hub_download("wikilangs/tok", "model.bin")) - Notebooks
- Google Colab
- Kaggle

- Xet hash:
- 6ca824d8bae415136714261891ee6832db39280b4f4243e1988f4be04d8a2cca
- Size of remote file:
- 153 kB
- SHA256:
- 25af4e49db3f41a3d543241a8f822c557b560914fc77b219c9ca5d9beccb2c5e
·
Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.