Quantize F16 with llamafile-f2014a8d7f07d4fbfc2021f763c73c4d0e1c1d78 5fb760f verified jartine commited on Oct 8, 2024
Quantize Q6_K with llamafile-f2014a8d7f07d4fbfc2021f763c73c4d0e1c1d78 5057e19 verified jartine commited on Oct 8, 2024
Quantize BF16 with llamafile-7b395be84b6797117049d7473aa5a0d76a9892cb 73e9a28 verified jartine commited on Oct 2, 2024
Quantize F16 with llamafile-7b395be84b6797117049d7473aa5a0d76a9892cb 9efd38f verified jartine commited on Oct 2, 2024
Quantize Q6_K with llamafile-7b395be84b6797117049d7473aa5a0d76a9892cb a3f59ae verified jartine commited on Oct 2, 2024