Error with SDXL Lora about stable-diffusion-webui-tensorrt HOT 11 CLOSED

I was able to reproduce this issue, but currently, I have no idea why....

from stable-diffusion-webui-tensorrt.

I'm experiencing the exact same issue. Any updates on this?

from stable-diffusion-webui-tensorrt.

So this basically just got ignored? I am facing this too

from stable-diffusion-webui-tensorrt.

no need to feel sorry. Thx for your work! I continued trying to get sdxl Loras to work but all failed. 1.5 loras work though. Can you confirm that SDXL loras dont work at all in the moment?

from stable-diffusion-webui-tensorrt.

Just because it works sometimes, that doesn't mean that it will always work...

from stable-diffusion-webui-tensorrt.

I haven't encountered this issue yet. But it seems like the refitting is failing but I don't have an immediate answer. Generally LoRA support is not where I'd want it to be, and I hope to improve this in the future, but this might take some time.

from stable-diffusion-webui-tensorrt.

Tested around with other SDXL Loras and i get this error on every single one of them.

from stable-diffusion-webui-tensorrt.

I'm sorry for this inconvenience. I need to scope the work required to fix this, and it might take a while until I get it fixed.

from stable-diffusion-webui-tensorrt.

I tried to debug a little about what is wrong and since you mentioned i could be something with refitting. So i checked the refit method in utilities. Im not a big coder or have huge knowledge about this topic at all so i am not sure if this informations help you in any ways but just in case it saves you some time i post it here.
Failed to add Constant /Constant_output_0: 'Variable' object has no attribute 'values'. By checking the attributes of the n.outputs[0] i get this:
Attribute or Method: DYNAMIC
Attribute or Method: class
Attribute or Method: delattr
Attribute or Method: dict
Attribute or Method: dir
Attribute or Method: doc
Attribute or Method: eq
Attribute or Method: format
Attribute or Method: ge
Attribute or Method: getattribute
Attribute or Method: gt
Attribute or Method: hash
Attribute or Method: init
Attribute or Method: init_subclass
Attribute or Method: le
Attribute or Method: lt
Attribute or Method: module
Attribute or Method: ne
Attribute or Method: new
Attribute or Method: reduce
Attribute or Method: reduce_ex
Attribute or Method: repr
Attribute or Method: setattr
Attribute or Method: sizeof
Attribute or Method: str
Attribute or Method: subclasshook
Attribute or Method: weakref
Attribute or Method: copy
Attribute or Method: dtype
Attribute or Method: empty
Attribute or Method: i
Attribute or Method: inputs
Attribute or Method: is_empty
Attribute or Method: name
Attribute or Method: o
Attribute or Method: outputs
Attribute or Method: shape
Attribute or Method: to_constant
Attribute or Method: to_variable
No clue if that helps in any ways.

from stable-diffusion-webui-tensorrt.

same here,

Add Constant /output_blocks.5/output_blocks.5.1/Constant_14_output_0

ERROR:root:Failed to add Constant /output_blocks.5/output_blocks.5.1/Constant_14_output_0

Add Constant onnx::Unsqueeze_33535

ERROR:root:Failed to add Constant onnx::Unsqueeze_33535

Add Constant onnx::Unsqueeze_33537

ERROR:root:Failed to add Constant onnx::Unsqueeze_33537

Add Constant onnx::Unsqueeze_33539

ERROR:root:Failed to add Constant onnx::Unsqueeze_33539

Add Constant onnx::Unsqueeze_33541

ERROR:root:Failed to add Constant onnx::Unsqueeze_33541

Add Constant onnx::Unsqueeze_33546

ERROR:root:Failed to add Constant onnx::Unsqueeze_33546

Add Constant onnx::Unsqueeze_33548

ERROR:root:Failed to add Constant onnx::Unsqueeze_33548

Add Constant onnx::Unsqueeze_33550

ERROR:root:Failed to add Constant onnx::Unsqueeze_33550

Add Constant onnx::Unsqueeze_33552

ERROR:root:Failed to add Constant onnx::Unsqueeze_33552

Add Constant /output_blocks.5/output_blocks.5.2/Constant_output_0

ERROR:root:Failed to add Constant /output_blocks.5/output_blocks.5.2/Constant_output_0

Add Constant /output_blocks.6/output_blocks.6.0/in_layers/in_layers.0/Constant_output_0

ERROR:root:Failed to add Constant /output_blocks.6/output_blocks.6.0/in_layers/in_layers.0/Constant_output_0

Add Constant /output_blocks.6/output_blocks.6.0/in_layers/in_layers.0/Constant_1_output_0

ERROR:root:Failed to add Constant /output_blocks.6/output_blocks.6.0/in_layers/in_layers.0/Constant_1_output_0

Add Constant /output_blocks.6/output_blocks.6.0/in_layers/in_layers.0/Constant_2_output_0

ERROR:root:Failed to add Constant /output_blocks.6/output_blocks.6.0/in_layers/in_layers.0/Constant_2_output_0

Add Constant /output_blocks.6/output_blocks.6.0/Constant_output_0

ERROR:root:Failed to add Constant /output_blocks.6/output_blocks.6.0/Constant_output_0

Add Constant /output_blocks.6/output_blocks.6.0/Constant_1_output_0

ERROR:root:Failed to add Constant /output_blocks.6/output_blocks.6.0/Constant_1_output_0

Add Constant /output_blocks.6/output_blocks.6.0/out_layers/out_layers.0/Constant_output_0

ERROR:root:Failed to add Constant /output_blocks.6/output_blocks.6.0/out_layers/out_layers.0/Constant_output_0

Add Constant /output_blocks.6/output_blocks.6.0/out_layers/out_layers.0/Constant_1_output_0

ERROR:root:Failed to add Constant /output_blocks.6/output_blocks.6.0/out_layers/out_layers.0/Constant_1_output_0

Add Constant /output_blocks.6/output_blocks.6.0/out_layers/out_layers.0/Constant_2_output_0

ERROR:root:Failed to add Constant /output_blocks.6/output_blocks.6.0/out_layers/out_layers.0/Constant_2_output_0

Add Constant /output_blocks.7/output_blocks.7.0/in_layers/in_layers.0/Constant_output_0

ERROR:root:Failed to add Constant /output_blocks.7/output_blocks.7.0/in_layers/in_layers.0/Constant_output_0

Add Constant /output_blocks.7/output_blocks.7.0/in_layers/in_layers.0/Constant_1_output_0

ERROR:root:Failed to add Constant /output_blocks.7/output_blocks.7.0/in_layers/in_layers.0/Constant_1_output_0

Add Constant /output_blocks.7/output_blocks.7.0/in_layers/in_layers.0/Constant_2_output_0

ERROR:root:Failed to add Constant /output_blocks.7/output_blocks.7.0/in_layers/in_layers.0/Constant_2_output_0

Add Constant /output_blocks.7/output_blocks.7.0/Constant_output_0

ERROR:root:Failed to add Constant /output_blocks.7/output_blocks.7.0/Constant_output_0

Add Constant /output_blocks.7/output_blocks.7.0/Constant_1_output_0

ERROR:root:Failed to add Constant /output_blocks.7/output_blocks.7.0/Constant_1_output_0

Add Constant /output_blocks.7/output_blocks.7.0/out_layers/out_layers.0/Constant_output_0

ERROR:root:Failed to add Constant /output_blocks.7/output_blocks.7.0/out_layers/out_layers.0/Constant_output_0

Add Constant /output_blocks.7/output_blocks.7.0/out_layers/out_layers.0/Constant_1_output_0

ERROR:root:Failed to add Constant /output_blocks.7/output_blocks.7.0/out_layers/out_layers.0/Constant_1_output_0

Add Constant /output_blocks.7/output_blocks.7.0/out_layers/out_layers.0/Constant_2_output_0

ERROR:root:Failed to add Constant /output_blocks.7/output_blocks.7.0/out_layers/out_layers.0/Constant_2_output_0

Add Constant /output_blocks.8/output_blocks.8.0/in_layers/in_layers.0/Constant_output_0

ERROR:root:Failed to add Constant /output_blocks.8/output_blocks.8.0/in_layers/in_layers.0/Constant_output_0

Add Constant /output_blocks.8/output_blocks.8.0/in_layers/in_layers.0/Constant_1_output_0

ERROR:root:Failed to add Constant /output_blocks.8/output_blocks.8.0/in_layers/in_layers.0/Constant_1_output_0

Add Constant /output_blocks.8/output_blocks.8.0/in_layers/in_layers.0/Constant_2_output_0

ERROR:root:Failed to add Constant /output_blocks.8/output_blocks.8.0/in_layers/in_layers.0/Constant_2_output_0

Add Constant /output_blocks.8/output_blocks.8.0/Constant_output_0

ERROR:root:Failed to add Constant /output_blocks.8/output_blocks.8.0/Constant_output_0

Add Constant /output_blocks.8/output_blocks.8.0/Constant_1_output_0

ERROR:root:Failed to add Constant /output_blocks.8/output_blocks.8.0/Constant_1_output_0

Add Constant /output_blocks.8/output_blocks.8.0/out_layers/out_layers.0/Constant_output_0

ERROR:root:Failed to add Constant /output_blocks.8/output_blocks.8.0/out_layers/out_layers.0/Constant_output_0

Add Constant /output_blocks.8/output_blocks.8.0/out_layers/out_layers.0/Constant_1_output_0

ERROR:root:Failed to add Constant /output_blocks.8/output_blocks.8.0/out_layers/out_layers.0/Constant_1_output_0

Add Constant /output_blocks.8/output_blocks.8.0/out_layers/out_layers.0/Constant_2_output_0

ERROR:root:Failed to add Constant /output_blocks.8/output_blocks.8.0/out_layers/out_layers.0/Constant_2_output_0

Add Constant /out/out.0/Constant_output_0

ERROR:root:Failed to add Constant /out/out.0/Constant_output_0

Add Constant /out/out.0/Constant_1_output_0

ERROR:root:Failed to add Constant /out/out.0/Constant_1_output_0

Add Constant /out/out.0/Constant_2_output_0

ERROR:root:Failed to add Constant /out/out.0/Constant_2_output_0

Finished refit. Dumping result to disk.
Traceback (most recent call last):
File "C:\AI\SD\stable-diffusion-webui\venv\lib\site-packages\gradio\routes.py", line 488, in run_predict
output = await app.get_blocks().process_api(
File "C:\AI\SD\stable-diffusion-webui\venv\lib\site-packages\gradio\blocks.py", line 1431, in process_api
result = await self.call_function(
File "C:\AI\SD\stable-diffusion-webui\venv\lib\site-packages\gradio\blocks.py", line 1103, in call_function
prediction = await anyio.to_thread.run_sync(
File "C:\AI\SD\stable-diffusion-webui\venv\lib\site-packages\anyio\to_thread.py", line 33, in run_sync
return await get_asynclib().run_sync_in_worker_thread(
File "C:\AI\SD\stable-diffusion-webui\venv\lib\site-packages\anyio_backends_asyncio.py", line 877, in run_sync_in_worker_thread
return await future
File "C:\AI\SD\stable-diffusion-webui\venv\lib\site-packages\anyio_backends_asyncio.py", line 807, in run
result = context.run(func, *args)
File "C:\AI\SD\stable-diffusion-webui\venv\lib\site-packages\gradio\utils.py", line 707, in wrapper
response = f(*args, **kwargs)
File "C:\AI\SD\stable-diffusion-webui\extensions\Stable-Diffusion-WebUI-TensorRT\ui_trt.py", line 262, in export_lora_to_trt
engine.refit(onnx_base_path, onnx_lora_path, dump_refit_path=trt_lora_path)
File "C:\AI\SD\stable-diffusion-webui\extensions\Stable-Diffusion-WebUI-TensorRT\utilities.py", line 277, in refit
save_file(
File "C:\AI\SD\stable-diffusion-webui\venv\lib\site-packages\safetensors\numpy.py", line 74, in save_file
if not _is_little_endian(tensor):
File "C:\AI\SD\stable-diffusion-webui\venv\lib\site-packages\safetensors\numpy.py", line 167, in _is_little_endian
byteorder = tensor.dtype.byteorder
AttributeError: 'NoneType' object has no attribute 'dtype'

from stable-diffusion-webui-tensorrt.

I use the v1-5-pruned-emaonly.safetensors [6ce0161689] model and still meet the same problem , how can I solve it

from stable-diffusion-webui-tensorrt.