gaopengpjlab / omniquant Goto Github PK
View Code? Open in Web Editor NEWThis project forked from opengvlab/omniquant
An efficient, accurate, and omnibearing quantization algorithm for LLMs, encompassing both weight-only quantization (W4A16/W3A16/W2A16) and weight-activation quantization (W6A6, W4A4)