← Open Source
qwopqwop200

GPTQ-for-LLaMa

4 bits quantization of LLaMA using GPTQ

InfrastructureModel optimizationPython
Open on GitHub
Momentum
+-1stars in 24 hours-0.0%
3.07k
Stars
452
Forks
+0
This week
26
Contributors
Created 2023-03-06 · Updated 2026-10-05 · #16788 today
Top developers