Comments (11)
same issues here, i just git checkout the extension to hotfix branch and restart, the problem solved. (didn't reinstall my webui)
from stable-diffusion-webui-tensorrt.
hot_fix
has been merged. I'll close the issue, but feel free to reopen if you still face issues.
from stable-diffusion-webui-tensorrt.
As yield
seems to be causing issues for some users it will be replaced by print and gr.Info. The changes are live on the hot_fix
branch right now.
Currently, I don't have an ETA when this branch will be merged into the master but hopefully by end of this week latest.
from stable-diffusion-webui-tensorrt.
Tried again on a fully fresh install of A1111, no other extensions than tensor RT - same issue trying to build the default engine
from stable-diffusion-webui-tensorrt.
Can confirm it is somehow related to #10 and the fix proposed there works (changing yield logging_history to print(logging_history)
from stable-diffusion-webui-tensorrt.
I have same problem on my OLD SD. Without addons also.
Any idea how to fix it? I have this error
Fresh SD working very well and I dont have error but I want to my loras, plugins etc...
from stable-diffusion-webui-tensorrt.
Having this issue, python 3.10.11 if it matters
from stable-diffusion-webui-tensorrt.
Re-installed the extension from hot_fix
. For others running into similar issues, if models/Unet-trt/model.json
is empty or not updated, the engine build did not complete successfully
from stable-diffusion-webui-tensorrt.
same issues here, i just git checkout the extension to hotfix branch and restart, the problem solved. (didn't install my webui)
How to intall hotfix? I have to delete and install again tensorrt exh? Or what?
from stable-diffusion-webui-tensorrt.
same issues here, i just git checkout the extension to hotfix branch and restart, the problem solved. (didn't install my webui)
How to intall hotfix? I have to delete and install again tensorrt exh? Or what?
You can click this branches and download the zip and replace the old folder.
or command
linux
cd extensions/Stable-Diffusion-WebUI-TensorRT
git checkout hot_fix
windows cmd
cd extensions\Stable-Diffusion-WebUI-TensorRT
git checkout hot_fix
from stable-diffusion-webui-tensorrt.
FYI hot_fix has been merged now.
Thank you for your great work, i got my 3060 12G speed up form 16s to 6s. This is epic!
However i heard that TensorRT can also speed up LLM, i hope the support of text-generation-webui will happen soon!
from stable-diffusion-webui-tensorrt.
Related Issues (20)
- how to generate json config file in the LoRA tab. HOT 1
- [branch: Controlnet_V2] ONNX IR model version conflict, how do i downgrade?
- [E] 3: getPluginCreator could not find plugin: InstanceNormalization_TRT version: 1 when building engine with latest TRT_VERSION="10.0.0b6"
- No config file found for You can generate it in the LoRA tab. HOT 3
- Advise to add promt token check in warning report
- [Feature Request] Add a Command Line Interface for the exporter process.
- AttributeError: 'tensorrt_bindings.tensorrt.ICudaEngine' object has no attribute 'get_profile_shape' HOT 2
- How to process a batch of images with ControlNet TensorRT in img2img ?
- Latest version of automatic1111 wont start with this extension installed. HOT 2
- AttributeError: 'NoneType' object has no attribute 'device_memory' HOT 8
- Error Code 3: API Usage Error (Parameter check failed
- Export LoRA to onnx depending on cyberrealistic_v31 can't fit to v1-5-pruned-emaonly_cnet_1846e6c3c239531e.trt
- TensorRT doesn't install on fresh A1111 install on Ubuntu, stuck at install after copy/paste de git link HOT 10
- TensorRT doesn't find Loras from subdirectories HOT 2
- TensorTR extension is building engine with wrong parameters
- may a name mistake in beta version (utilities.py)
- Engines not loading with text size larger than 75 HOT 1
- SD3 TensoRRT (sd3-clip-t5xxlfp8) works perfectly but cannot get SDXL ... HOT 1
- ONNX Export Error: Tensors on Different Devices (CPU and CUDA) HOT 1
- ValueError: __len__() should return >= 0
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from stable-diffusion-webui-tensorrt.