humbleakh's picture
Upload VLM model with 8-bit quantization for Chain-of-Zoom
7322441 verified
{
"model_type": "qwen2vl",
"quantization": "8-bit",
"architectures": [
"Qwen2VLForConditionalGeneration"
],
"torch_dtype": "bfloat16",
"precision": "8-bit",
"base_model": "Qwen/Qwen2.5-VL-3B-Instruct"
}