XXXXyu/Llama3-8B-1.58-100B-tokens-vlut-gguf
Text Generation • 8B • Updated • 49
vlut.cpp
SOTA ternary-packed versions of 1.58-bit LLMs for efficient on-device inference with vlut.cpp.
SOTA ternary-packed versions of 1.58-bit LLMs for efficient on-device inference with vlut.cpp.