How to use mertcobanov/turkish-bpe-tokenizer-50000 with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("mertcobanov/turkish-bpe-tokenizer-50000", device_map="auto")
