Zynerji's picture
NVFP4 (vLLM / TensorRT-LLM)
9a09dcf verified
Raw
History Blame
170 Bytes
default_stage:
default_modifiers:
QuantizationModifier:
targets: [Linear]
ignore: [lm_head]
scheme: NVFP4
bypass_divisibility_checks: false