neuralmagic/Llama-3.2-3B-Instruct-quantized.w8a8
Text Generation • 4B • Updated • 605
Neural Magic
company
Verified
AI & ML interests
LLMs, optimization, compression, sparsification, quantization, pruning, distillation, NLP, CV
dsikka
updated a
model 11 months ago
dsikka
published a
model 11 months ago
Breaking change in transformers
1
#1 opened about 1 year ago
by 
maldv
nm-research
updated 3
models about 1 year ago
Update preprocessor_config.json
2
#4 opened about 1 year ago
by 
ManishThota
nm-research
updated 5
models about 1 year ago
RedHatAI/Qwen2.5-VL-72B-Instruct-quantized.w4a16
Image-Text-to-Text • 74B • Updated • 667 • 8
RedHatAI/Qwen2.5-VL-7B-Instruct-quantized.w4a16
Image-Text-to-Text • 8B • Updated • 2.71k • 8
RedHatAI/Qwen2.5-VL-3B-Instruct-FP8-dynamic
Image-Text-to-Text • 4B • Updated • 53.4k • 3
RedHatAI/Qwen2.5-VL-3B-Instruct-quantized.w8a8
Image-Text-to-Text • 4B • Updated • 82.7k • 2
RedHatAI/Qwen2.5-VL-3B-Instruct-quantized.w4a16
Image-Text-to-Text • 4B • Updated • 102k • 4
shubhrapandit
updated 6
models about 1 year ago
RedHatAI/Pixtral-Large-Instruct-2411-hf-quantized.w4a16
Image-Text-to-Text • 125B • Updated • 24
RedHatAI/Pixtral-Large-Instruct-2411-hf-quantized.w8a8
Image-Text-to-Text • 124B • Updated • 25
RedHatAI/Pixtral-Large-Instruct-2411-hf-FP8-dynamic
Image-Text-to-Text • 124B • Updated • 91 • 1
RedHatAI/Qwen2-VL-72B-Instruct-quantized.w4a16
Image-Text-to-Text • 74B • Updated • 8
RedHatAI/Qwen2-VL-72B-Instruct-quantized.w8a8
Image-Text-to-Text • 73B • Updated • 11
RedHatAI/Qwen2-VL-72B-Instruct-FP8-dynamic
Image-Text-to-Text • 73B • Updated • 32