vLLM
compressed-tensors
New discussion