mpt-30b-chat-w4a16-gptq / generation_config.json
adamrb's picture
Upload w4a16 version of MPT-30B-Chat
bc2edcc verified
Raw
History Blame Contribute Delete
133 Bytes
{
"_from_model_config": true,
"eos_token_id": [
0,
50278
],
"transformers_version": "4.53.2",
"use_cache": false
}