Failed building wheel for auto-gptq about chatdocs HOT 3 CLOSED

In the error it shows it is trying to use C:\Program Files (x86)\Microsoft Visual Studio\2022 not 2019. Can you please try updating CUDA to 11.8
Also the CUDA toolkit version should be same as the CUDA version PyTorch was compiled with for auto-gptq to work.
Can you please share the PyTorch version you have installed (pip freeze). It looks something like torch==2.0.1+cu118

If you have CUDA 11.8 you can also download and install prebuilt wheels from here that don't require compilation:

pip install auto_gptq-0.2.2+cu118-cp310-cp310-win_amd64.whl

If none of these work, you can disable building the CUDA extension:

BUILD_CUDA_EXT=0 pip install auto-gptq

from chatdocs.

pip install auto_gptq-0.2.2+cu118-cp310-cp310-win_amd64.whl fixed it.

from chatdocs.

Thank you!

from chatdocs.