inference-optimization/Llama-3.1-8B-Instruct-NVFP4
5B • Updated • 19 • 1
nvfp4-llama3.1-8b-ablations
-
-
inference-optimization/Llama-3.1-8B-Instruct-NVFP4-GPTQ-BlockSize16
5B • Updated • 6 • 1 -
inference-optimization/Llama-3.1-8B-Instruct-NVFP4-GPTQ
5B • Updated • 19 -
inference-optimization/Llama-3.1-8B-Instruct-NVFP4-GPTQ-SmoothQuant
5B • Updated • 19 -
inference-optimization/Llama-3.1-8B-Instruct-NVFP4-SmoothQuant
5B • Updated • 17