Transformers
gpt2-tokenizer-bert-processing / added_tokens.json
JakeOh's picture
Upload tokenizer
13d8551 verified
Raw
History Blame Contribute Delete
44 Bytes
{
"<|mask|>": 50258,
"<|pad|>": 50257
}