How to use mertcobanov/turkish-bpe-tokenizer-30000 with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("mertcobanov/turkish-bpe-tokenizer-30000", device_map="auto")
