pumadic-en-pl / tokenizer_config.json
pumad's picture
Upload folder using huggingface_hub
e03e558 verified
Raw
History Blame
146 Bytes
{
"eos_token": "</s>",
"model_max_length": 512,
"pad_token": "<pad>",
"source_lang": "en",
"target_lang": "pl",
"unk_token": "<unk>"
}