TensorRT doesn't install on fresh A1111 install on Ubuntu, stuck at install after copy/paste de git link about stable-diffusion-webui-tensorrt HOT 10 OPEN

Manually install all pip packages mentioned in the install.py of the trt plugin in your python virtual environment, and then comment out the part about pip uninstalling cudnn in install.py before starting webui.sh. The above method works for me.

from stable-diffusion-webui-tensorrt.

Manually install all pip packages mentioned in the install.py of the trt plugin in your python virtual environment, and then comment out the part about pip uninstalling cudnn in install.py before starting webui.sh. The above method works for me.

So do you mean I should install this extension manually by doing a git clone of this repository in the extensions folder ? then manually install the dependencies, then comment pip uninstalling cudnn in install.py that is located in the newly created folder inside the extensions folder ? I tried that but the webui never started, and stops after basic initialization, it doesn't even start the gradio server interface

I did the extension route, then after a few minutes, killed the webui.sh, followed the instructions and reran the webui.sh. Or you can do the get clone command in the extension folder to save time. Got it working!

from stable-diffusion-webui-tensorrt.

Manually install all pip packages mentioned in the install.py of the trt plugin in your python virtual environment, and then comment out the part about pip uninstalling cudnn in install.py before starting webui.sh. The above method works for me.

So do you mean I should install this extension manually by doing a git clone of this repository in the extensions folder ? then manually install the dependencies, then comment pip uninstalling cudnn in install.py that is located in the newly created folder inside the extensions folder ? I tried that but the webui never started, and stops after basic initialization, it doesn't even start the gradio server interface

I did the extension route, then after a few minutes, killed the webui.sh, followed the instructions and reran the webui.sh. Or you can do the get clone command in the extension folder to save time. Got it working!

What @sup2069 is saying is to go into the extensions folder and run the git clone on the repo. Then comment out the problem code. I think the problem comes form Nvidia making this extension for Windos users. So, when you run webui.sh it tries running some .exe commands that work natively on Windows but when using WSL or Linux it just causes problems. I'm by no means a pro, and that this might not actuly be the resons why it's not working without some modifications, but this is my leading theory.

My fix

When you Open the install.py with a Text editor like VS Code or Notepad you'll find on line (on line 34) that says "if launch.is_installed("nvidia-cudnn-cu11"):" this the part @sup2069 wants you to comment out (Place a # in front to comment it out). I had some other problems after I got it fully loaded, and brought up the web environment.

I ran into a new error where when I tried to make some TRTs it started saying that some of the packages were not installed and would soft fail. I tried to fix this by going back into the install.py and forcing it to install some of the packages. As of now, I can not make any TRTs. I tried several fixes here on GitHub, but after several hours I have returned empty-handed.

I'm running this on Ubuntu in WSL, using Forge (RIP).

from stable-diffusion-webui-tensorrt.

same on ubuntu it stucks forever

from stable-diffusion-webui-tensorrt.

same

from stable-diffusion-webui-tensorrt.

I am running into the same issue but on Debian Sid:

RTX 3090
A1111 version 1.9.0-RC-7-gradadb4e3
python: 3.10.10
torch 2.3.0+cu121
xformers: 0.0.26.post1
gradio: 3.41.2
64GB Ram
12th Gen Intel(R) Core(TM) i9-12900K

from stable-diffusion-webui-tensorrt.

I solved this problem and pubislihed installers for runpod and massed compute (Ubuntu)

Runpod installer : https://www.patreon.com/posts/1-click-for-sd-86438018

Massed compute installer (Ubuntu Linux) :
https://www.patreon.com/posts/massed-compute-105735932

It is a shame that 2 trillion dollar company doesn't care

Also my installers install a fork that supports Lora perfectly for TensorRT

from stable-diffusion-webui-tensorrt.

Too bad your stuff is behind a paywall.. it's not very open source friendly imho

from stable-diffusion-webui-tensorrt.

Manually install all pip packages mentioned in the install.py of the trt plugin in your python virtual environment, and then comment out the part about pip uninstalling cudnn in install.py before starting webui.sh. The above method works for me.

So do you mean I should install this extension manually by doing a git clone of this repository in the extensions folder ? then manually install the dependencies, then comment pip uninstalling cudnn in install.py that is located in the newly created folder inside the extensions folder ? I tried that but the webui never started, and stops after basic initialization, it doesn't even start the gradio server interface

from stable-diffusion-webui-tensorrt.

I found this post that helped me fix the issue.
#204 (comment)

from stable-diffusion-webui-tensorrt.