How to use yakul259/english-wordpiece-tokenizer-60k with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("yakul259/english-wordpiece-tokenizer-60k", dtype="auto")
