GLM-4-32B-0414-awq / recipe.yaml
AMead10's picture
Upload AWQ quantized THUDM/GLM-4-32B-0414
b5ac845 verified
Raw
History Blame Contribute Delete
126 Bytes
default_stage:
default_modifiers:
AWQModifier:
targets: [Linear]
ignore: [lm_head]
scheme: W4A16_ASYM