潘其威(William)

An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.

LLM model quantization (compression) toolkit with HW acceleration support for Nvidia, AMD, Intel GPU and Intel/AMD/Apple CPU via HF, vLLM, and SGLang.