Portable tokenizer resolution: processor_name -> repo id, add preprocessor_config.json

2663b92

verified

geonmin-kim commited on 9 days ago