No module named 'awq_inference_engine' about llm-awq HOT 2 OPEN

Hi @Alpslee , thank you for your interest in AWQ & TinyChat. Did you run the following commands to build the awq_inference_engine?

cd awq/kernels
python setup.py install

from llm-awq.

Hi @Alpslee , thank you for your interest in AWQ & TinyChat. Did you run the following commands to build the awq_inference_engine?

cd awq/kernels
python setup.py install

i forgot this step,thanks. now i got new error:
from transformers.models.gemma.modeling_gemma import GemmaRMSNorm
ModuleNotFoundError: No module named 'transformers.models.gemma'
i tried to update transformers but got this:
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
awq 0.1.0 requires transformers==4.36.2, but you have transformers 4.40.2 which is incompatible.
vila 1.0.0 requires transformers==4.36.2, but you have transformers 4.40.2 which is incompatible.

from llm-awq.