Adding a form in the settings for additional models location would be a nice quality of life improvement. People can use the yaml file in the comfyui directory to setup models, but having it in the settings of the extension directly would be more user friendly.

Currently, the javascript code is doing polling every 200ms to calculate the new height and update it. It would be better to update the height only on:

• window resize
• comfyui tab clicked

on : a21c282

I never had SigmoidCorrection be able to load, with this latest pull the others started failing import.
The traceback started showing up today after the update. Never had that before.
A couple of pulls before, it started saying it didn't find sigmoid when I opened the postprocess workflow.
Didn't do that before. Now it tells a few more aren't available.
Am o windows 10 and on webui 1.5.1

console relevant part:

[ComfyUI] [sd-webui-comfyui] Injecting custom extensions...
[ComfyUI] Total VRAM 8192 MB, total RAM 32620 MB
[ComfyUI] xformers version: 0.0.20
[ComfyUI] Set vram state to: NORMAL_VRAM
[ComfyUI] Device: cuda:0 NVIDIA GeForce RTX 3070 Laptop GPU : native
[ComfyUI] Using xformers cross attention
[ComfyUI] [sd-webui-comfyui] Launching ComfyUI with arguments: --listen 127.0.0.1 --port 8189
[ComfyUI] Adding extra search path checkpoints D:\WORK\conda_envs\automatic\stable-diffusion-webui\models/Stable-diffusion
[ComfyUI] Adding extra search path configs D:\WORK\conda_envs\automatic\stable-diffusion-webui\models/Stable-diffusion
[ComfyUI] Adding extra search path vae D:\WORK\conda_envs\automatic\stable-diffusion-webui\models/VAE
[ComfyUI] Adding extra search path loras D:\WORK\conda_envs\automatic\stable-diffusion-webui\models/Lora
[ComfyUI] Adding extra search path upscale_models D:\WORK\conda_envs\automatic\stable-diffusion-webui\models/ESRGAN
[ComfyUI] Adding extra search path upscale_models D:\WORK\conda_envs\automatic\stable-diffusion-webui\models/SwinIR
[ComfyUI] Adding extra search path embeddings D:\WORK\conda_envs\automatic\stable-diffusion-webui\embeddings
[ComfyUI] Adding extra search path hypernetworks D:\WORK\conda_envs\automatic\stable-diffusion-webui\models/hypernetworks
[ComfyUI] Adding extra search path controlnet D:\WORK\conda_envs\automatic\stable-diffusion-webui\models/ControlNet
[ComfyUI] [Allor]: 10 standard nodes was overridden.
[ComfyUI] Traceback (most recent call last):
File "D:\WORK\conda_envs\ConfyUI\ComfyUI_windows_portable\ComfyUI\nodes.py", line 1604, in load_custom_node
module_spec.loader.exec_module(module)
File "", line 883, in exec_module
File "", line 241, in call_with_frames_removed
File "D:\WORK\conda_envs\ConfyUI\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-Allor_init.py", line 10, in
NODE_CLASS_MAPPINGS = loader.get_modules()
File "D:\WORK\conda_envs\ConfyUI\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-Allor\Loader.py", line 100, in get_modules
from .modules import ImageSegmentation
File "D:\WORK\conda_envs\ConfyUI\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-Allor\modules\ImageSegmentation.py", line 3, in
from rembg import remove, new_session
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\rembg_init_.py", line 5, in
from .bg import remove
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\rembg\bg.py", line 16, in
from pymatting.alpha.estimate_alpha_cf import estimate_alpha_cf
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\pymatting_init_.py", line 2, in
from pymatting.util import *
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\pymatting\util_init_.py", line 2, in
from pymatting.util.kdtree import KDTree, knn
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\pymatting\util\kdtree.py", line 2, in
from numba import njit, prange
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\numba_init_.py", line 88, in
from numba.core.decorators import (cfunc, generated_jit, jit, njit, stencil,
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\numba\core\decorators.py", line 12, in
from numba.stencils.stencil import stencil
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\numba\stencils\stencil.py", line 11, in
from numba.core import types, typing, utils, ir, config, ir_utils, registry
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\numba\core\registry.py", line 5, in
from numba.core import utils, typing, dispatcher, cpu
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\numba\core\dispatcher.py", line 13, in
from numba.core import (
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\numba\core\compiler.py", line 6, in
from numba.core import (utils, errors, typing, interpreter, bytecode, postproc,
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\numba\core\callconv.py", line 13, in
from numba.core.base import PYOBJECT, GENERIC_POINTER
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\numba\core\base.py", line 20, in
from numba.cpython import builtins
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\numba\cpython\builtins.py", line 536, in
from numba.core.typing.builtins import IndexValue, IndexValueType
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\numba\core\typing\builtins.py", line 22, in
@infer_global(print)
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\numba\core\typing\templates.py", line 1271, in register_global
if getattr(mod, val.name) is not val:
AttributeError: module 'lib_comfyui.comfyui_pre_main' has no attribute ''

[ComfyUI] Cannot import D:\WORK\conda_envs\ConfyUI\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-Allor module for custom nodes: module 'lib_comfyui.comfyui_pre_main' has no attribute ''
[ComfyUI] ### Loading: ComfyUI-Impact-Pack (V2.21.2)
[ComfyUI] ### Loading: ComfyUI-Manager (V0.14)
[ComfyUI] ### ComfyUI Revision: 1233 [834ab278]
[ComfyUI] [Allor]: 0 standard nodes was overridden.
[ComfyUI] Traceback (most recent call last):
File "D:\WORK\conda_envs\ConfyUI\ComfyUI_windows_portable\ComfyUI\nodes.py", line 1604, in load_custom_node
module_spec.loader.exec_module(module)
File "", line 883, in exec_module
File "", line 241, in call_with_frames_removed
File "D:\WORK\conda_envs\ConfyUI\ComfyUI_windows_portable\ComfyUI\custom_nodes\comfyui_allor_init.py", line 10, in
NODE_CLASS_MAPPINGS = loader.get_modules()
File "D:\WORK\conda_envs\ConfyUI\ComfyUI_windows_portable\ComfyUI\custom_nodes\comfyui_allor\Loader.py", line 100, in get_modules
from .modules import ImageSegmentation
File "D:\WORK\conda_envs\ConfyUI\ComfyUI_windows_portable\ComfyUI\custom_nodes\comfyui_allor\modules\ImageSegmentation.py", line 3, in
from rembg import remove, new_session
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\rembg_init_.py", line 5, in
from .bg import remove
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\rembg\bg.py", line 16, in
from pymatting.alpha.estimate_alpha_cf import estimate_alpha_cf
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\pymatting_init_.py", line 2, in
from pymatting.util import *
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\pymatting\util_init_.py", line 2, in
from pymatting.util.kdtree import KDTree, knn
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\pymatting\util\kdtree.py", line 2, in
from numba import njit, prange
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\numba_init_.py", line 88, in
from numba.core.decorators import (cfunc, generated_jit, jit, njit, stencil,
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\numba\core\decorators.py", line 12, in
from numba.stencils.stencil import stencil
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\numba\stencils\stencil.py", line 11, in
from numba.core import types, typing, utils, ir, config, ir_utils, registry
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\numba\core\registry.py", line 5, in
from numba.core import utils, typing, dispatcher, cpu
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\numba\core\dispatcher.py", line 13, in
from numba.core import (
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\numba\core\compiler.py", line 6, in
from numba.core import (utils, errors, typing, interpreter, bytecode, postproc,
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\numba\core\callconv.py", line 13, in
from numba.core.base import PYOBJECT, GENERIC_POINTER
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\numba\core\base.py", line 20, in
from numba.cpython import builtins
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\numba\cpython\builtins.py", line 536, in
from numba.core.typing.builtins import IndexValue, IndexValueType
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\numba\core\typing\builtins.py", line 22, in
@infer_global(print)
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\numba\core\typing\templates.py", line 1271, in register_global
if getattr(mod, val.name) is not val:
AttributeError: module 'lib_comfyui.comfyui_pre_main' has no attribute ''

[ComfyUI] Cannot import D:\WORK\conda_envs\ConfyUI\ComfyUI_windows_portable\ComfyUI\custom_nodes\comfyui_allor module for custom nodes: module 'lib_comfyui.comfyui_pre_main' has no attribute ''
[ComfyUI] Comfyroll Custom Nodes: Loaded
[ComfyUI] Traceback (most recent call last):
File "D:\WORK\conda_envs\ConfyUI\ComfyUI_windows_portable\ComfyUI\nodes.py", line 1604, in load_custom_node
module_spec.loader.exec_module(module)
File "", line 883, in exec_module
File "", line 241, in call_with_frames_removed
File "D:\WORK\conda_envs\ConfyUI\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI_ImageProcessing_init.py", line 1, in
from .imageprocessing import NODE_CLASS_MAPPINGS, NODE_DISPLAY_NAME_MAPPINGS
File "D:\WORK\conda_envs\ConfyUI\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI_ImageProcessing\imageprocessing.py", line 2, in
from kornia.filters import bilateral_blur, unsharp_mask
ImportError: cannot import name 'bilateral_blur' from 'kornia.filters' (d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\kornia\filters_init_.py)

[ComfyUI] Cannot import D:\WORK\conda_envs\ConfyUI\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI_ImageProcessing module for custom nodes: cannot import name 'bilateral_blur' from 'kornia.filters' (d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\kornia\filters_init_.py)
[ComfyUI] Total VRAM 8192 MB, total RAM 32620 MB
[ComfyUI] xformers version: 0.0.20
[ComfyUI] Set vram state to: NORMAL_VRAM
[ComfyUI] Device: cuda:0 NVIDIA GeForce RTX 3070 Laptop GPU : native
[ComfyUI] Traceback (most recent call last):
File "D:\WORK\conda_envs\ConfyUI\ComfyUI_windows_portable\ComfyUI\nodes.py", line 1604, in load_custom_node
module_spec.loader.exec_module(module)
File "", line 883, in exec_module
File "", line 241, in call_with_frames_removed
File "D:\WORK\conda_envs\ConfyUI\ComfyUI_windows_portable\ComfyUI\custom_nodes\was-node-suite-comfyui_init.py", line 1, in
from .WAS_Node_Suite import NODE_CLASS_MAPPINGS
File "D:\WORK\conda_envs\ConfyUI\ComfyUI_windows_portable\ComfyUI\custom_nodes\was-node-suite-comfyui\WAS_Node_Suite.py", line 37, in
from numba import jit
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\numba_init_.py", line 88, in
from numba.core.decorators import (cfunc, generated_jit, jit, njit, stencil,
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\numba\core\decorators.py", line 12, in
from numba.stencils.stencil import stencil
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\numba\stencils\stencil.py", line 11, in
from numba.core import types, typing, utils, ir, config, ir_utils, registry
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\numba\core\registry.py", line 5, in
from numba.core import utils, typing, dispatcher, cpu
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\numba\core\dispatcher.py", line 13, in
from numba.core import (
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\numba\core\compiler.py", line 6, in
from numba.core import (utils, errors, typing, interpreter, bytecode, postproc,
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\numba\core\callconv.py", line 13, in
from numba.core.base import PYOBJECT, GENERIC_POINTER
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\numba\core\base.py", line 20, in
from numba.cpython import builtins
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\numba\cpython\builtins.py", line 536, in
from numba.core.typing.builtins import IndexValue, IndexValueType
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\numba\core\typing\builtins.py", line 22, in
@infer_global(print)
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\numba\core\typing\templates.py", line 1271, in register_global
if getattr(mod, val.name) is not val:
AttributeError: module 'lib_comfyui.comfyui_pre_main' has no attribute ''

[ComfyUI] Cannot import D:\WORK\conda_envs\ConfyUI\ComfyUI_windows_portable\ComfyUI\custom_nodes\was-node-suite-comfyui module for custom nodes: module 'lib_comfyui.comfyui_pre_main' has no attribute ''
[ComfyUI]
Import times for custom nodes:
[ComfyUI] 0.0 seconds: D:\WORK\conda_envs\ConfyUI\ComfyUI_windows_portable\ComfyUI\custom_nodes\Pseudo_HDR_ally.py
[ComfyUI] 0.0 seconds: D:\WORK\conda_envs\ConfyUI\ComfyUI_windows_portable\ComfyUI\custom_nodes\sampler_rescalecfg.py
[ComfyUI] 0.0 seconds: D:\WORK\conda_envs\ConfyUI\ComfyUI_windows_portable\ComfyUI\custom_nodes\saturation_ally.py
[ComfyUI] 0.0 seconds: D:\WORK\conda_envs\automatic\stable-diffusion-webui\extensions\sd-webui-comfyui\comfyui_custom_nodes\webui_postprocess_output.py
[ComfyUI] 0.0 seconds: D:\WORK\conda_envs\ConfyUI\ComfyUI_windows_portable\ComfyUI\custom_nodes\sharpness_ally.py
[ComfyUI] 0.0 seconds: D:\WORK\conda_envs\ConfyUI\ComfyUI_windows_portable\ComfyUI\custom_nodes\histogram_equalization.py
[ComfyUI] 0.0 seconds: D:\WORK\conda_envs\ConfyUI\ComfyUI_windows_portable\ComfyUI\custom_nodes\imageflip_ally.py
[ComfyUI] 0.0 seconds: D:\WORK\conda_envs\automatic\stable-diffusion-webui\extensions\sd-webui-comfyui\comfyui_custom_nodes\webui_postprocess_input.py
[ComfyUI] 0.0 seconds: D:\WORK\conda_envs\automatic\stable-diffusion-webui\extensions\sd-webui-comfyui\comfyui_custom_nodes\webui_save_image.py
[ComfyUI] 0.0 seconds: D:\WORK\conda_envs\ConfyUI\ComfyUI_windows_portable\ComfyUI\custom_nodes\gaussian_blur_ally.py
[ComfyUI] 0.0 seconds: D:\WORK\conda_envs\ConfyUI\ComfyUI_windows_portable\ComfyUI\custom_nodes\brightness_contrast_ally.py
[ComfyUI] 0.0 seconds: D:\WORK\conda_envs\ConfyUI\ComfyUI_windows_portable\ComfyUI\custom_nodes\bsz-auto-hires.py
[ComfyUI] 0.0 seconds: D:\WORK\conda_envs\ConfyUI\ComfyUI_windows_portable\ComfyUI\custom_nodes\conditioning_sizing_for_SDXL.py
[ComfyUI] 0.0 seconds: D:\WORK\conda_envs\ConfyUI\ComfyUI_windows_portable\ComfyUI\custom_nodes\SeargeSDXL
[ComfyUI] 0.0 seconds: D:\WORK\conda_envs\ConfyUI\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI_ADV_CLIP_emb
[ComfyUI] 0.0 seconds: D:\WORK\conda_envs\ConfyUI\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-post-processing-nodes
[ComfyUI] 0.0 seconds: D:\WORK\conda_envs\ConfyUI\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI_Noise
[ComfyUI] 0.0 seconds: D:\WORK\conda_envs\ConfyUI\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI_TiledKSampler
[ComfyUI] 0.0 seconds (IMPORT FAILED): D:\WORK\conda_envs\ConfyUI\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI_ImageProcessing
[ComfyUI] 0.0 seconds: D:\WORK\conda_envs\automatic\stable-diffusion-webui\extensions\sd-webui-comfyui\comfyui_custom_nodes\webui_checkpoint_loader.py
[ComfyUI] 0.0 seconds: D:\WORK\conda_envs\ConfyUI\ComfyUI_windows_portable\ComfyUI\custom_nodes\comfyui-animatediff
[ComfyUI] 0.0 seconds: D:\WORK\conda_envs\ConfyUI\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI_UltimateSDUpscale
[ComfyUI] 0.0 seconds: D:\WORK\conda_envs\ConfyUI\ComfyUI_windows_portable\ComfyUI\custom_nodes\Derfuu_ComfyUI_ModdedNodes
[ComfyUI] 0.0 seconds: D:\WORK\conda_envs\ConfyUI\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI_Comfyroll_CustomNodes
[ComfyUI] 0.0 seconds (IMPORT FAILED): D:\WORK\conda_envs\ConfyUI\ComfyUI_windows_portable\ComfyUI\custom_nodes\comfyui_allor
[ComfyUI] 0.0 seconds (IMPORT FAILED): D:\WORK\conda_envs\ConfyUI\ComfyUI_windows_portable\ComfyUI\custom_nodes\was-node-suite-comfyui
[ComfyUI] 0.1 seconds (IMPORT FAILED): D:\WORK\conda_envs\ConfyUI\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-Allor
[ComfyUI] 0.4 seconds: D:\WORK\conda_envs\ConfyUI\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-Manager
[ComfyUI] 1.0 seconds: D:\WORK\conda_envs\ConfyUI\ComfyUI_windows_portable\ComfyUI\custom_nodes\efficiency-nodes-comfyui
[ComfyUI] 1.7 seconds: D:\WORK\conda_envs\ConfyUI\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-Impact-Pack
[ComfyUI]
[ComfyUI] Starting server

[ComfyUI] To see the GUI go to: http://127.0.0.1:8189
[ComfyUI] [sd-webui-comfyui] registered new ComfyUI client - comfyui_general_tab
[ComfyUI] [sd-webui-comfyui] registered new ComfyUI client - comfyui_postprocess_txt2img
[ComfyUI] [sd-webui-comfyui] registered new ComfyUI client - comfyui_postprocess_img2img

When drag and dropping images in specific workflow types, it would be nice to load the associated workflow.

To be more precise, drag and dropping this image there

would load the Postprocess workflow that is present in the image, but wouldn't modify the other workflow types.

Hi ModelSurge

After install ComfyUI manager I manager to install missing node however some node require some module in the venv folder such as numba module etc...

The WebUI has all the modules but I dont know to config the extension to find in the venv folder

Please help, thank in advance

Very often I have this error.

Python 3.10.6 (tags/v3.10.6:9c7b4bd, Aug 1 2022, 21:53:49) [MSC v.1932 64 bit (AMD64)]
Automatic1111 WebUI Version: ## 1.4.1
Commit hash: f865d3e11647dfd6c7b2cdf90dde24680e58acd8

I try to copy the work to redirect A1111 to Comfy but the gif missing the information which making this process not work, please provide us a clearer workflow. Thank you so much

Would be nice to have a node "WebuiCheckpointLoader" that can use the checkpoint that's already in memory.

Printing log shows it stuck at async_comfyui_loader file main function ipc.start_callback_listeners() statement。


ComfyUI already installed at extensions/sd-webui-comfyui/ComfyUI

When I tried to use the WebuiSaveImage node, I got the following error.

Error occurred when executing WebuiSaveImage:

No module named 'lib_comfyui.webui_paths'

File "C:\ComfyUI_windows_portable\ComfyUI\execution.py", line 151, in recursive_execute
output_data, output_ui = get_output_data(obj, input_data_all)
File "C:\ComfyUI_windows_portable\ComfyUI\execution.py", line 81, in get_output_data
return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True)
File "C:\ComfyUI_windows_portable\ComfyUI\execution.py", line 74, in map_node_over_list
results.append(getattr(obj, func)(**slice_dict(input_data_all, i)))
File "C:\stable-diffusion-webui\extensions\sd-webui-comfyui\comfyui_custom_nodes\webui_save_image.py", line 34, in save_image
filename, _ = WebuiSaveImage.webui_save_image(image=pil_image, path=save_path, basename='')
File "C:\stable-diffusion-webui\extensions\sd-webui-comfyui\comfyui_custom_nodes\webui_save_image.py", line 40, in webui_save_image
from lib_comfyui.webui_paths import save_image

Opening a web client too early fails to load the comfyui iframes. The client has to reload the iframes automatically, which it does not do at the moment.

I've run into an issue: the TAESD previews stopped working after connecting ComfyUI as a plugin, both as A1111 plugin and standalone. The standalone configuration wasn't changed, and I don't remember updating it.
Chances are, the first run messed up something in my venv. There were no errors, but I saw the startup was odd and it was installing some libraries. Please, don't do that. The plugin shouldn't change ANYTHING in an existing installation unless it's absolutely essential for the extension's function.

I tried using chrome and Edge and it is the same display, the comfyUI interface is at the bottom of the page instead of in the middle.

Hey, I am unsure if this is similar to the domain issue from about 2 weeks back but I am having an issue when attempting to load comfyui through the webui remotely. This is within the vlad/SD.Next, windows 11. All installed fine no error outputs in the terminal and it accepts the 0.0.0.0:8189 input for the cli webui argument to point at the ComfyUi.

Screenshot of what occurs:

Terminal output:
PS D:\AI Stuff\Vlad1111> .\webui.bat --listen --comfyui-listen
Using VENV: D:\AI Stuff\Vlad1111\venv
10:25:03-696502 INFO Starting SD.Next
10:25:03-702502 INFO Python 3.10.6 on Windows
10:25:03-726502 INFO Version: 9d17cf4c Mon Aug 7 19:50:39 2023 +0300
10:25:04-188180 INFO Latest published version: ff2d846667f62bd83a49b85e44e137e97c64727b 2023-08-07T21:51:23Z
10:25:04-191699 INFO nVidia CUDA toolkit detected
10:25:04-269290 WARNING Modified files: ['modules/lora', 'modules/lycoris']
10:25:04-294546 INFO Disabled extensions: ['sd-webui-agent-scheduler']
10:25:04-295547 INFO Enabled extensions-builtin: ['a1111-sd-webui-lycoris', 'clip-interrogator-ext', 'LDSR', 'Lora',
'multidiffusion-upscaler-for-automatic1111', 'ScuNET', 'sd-dynamic-thresholding', 'sd-extension-system-info',
'sd-webui-controlnet', 'stable-diffusion-webui-images-browser', 'stable-diffusion-webui-rembg', 'SwinIR']
10:25:04-297546 INFO Enabled extensions: ['a1111-sd-webui-tagcomplete', 'novelai-2-local-prompt', 'OneButtonPrompt', 'openpose-editor',
'sd-canvas-editor', 'sd-webui-3d-open-pose-editor', 'sd-webui-comfyui', 'sd-webui-infinite-image-browsing',
'sd-webui-inpaint-anything', 'sd-webui-regional-prompter', 'stable-diffusion-webui-aesthetic-image-scorer',
'Stable-Diffusion-Webui-Civitai-Helper']
10:25:04-301064 INFO Verifying requirements
10:25:04-308064 INFO Verifying packages
10:25:04-313571 INFO Verifying repositories
10:25:08-099765 INFO Verifying submodules
10:25:23-322068 INFO Extensions enabled: ['a1111-sd-webui-lycoris', 'clip-interrogator-ext', 'LDSR', 'Lora',
'multidiffusion-upscaler-for-automatic1111', 'ScuNET', 'sd-dynamic-thresholding', 'sd-extension-system-info',
'sd-webui-controlnet', 'stable-diffusion-webui-images-browser', 'stable-diffusion-webui-rembg', 'SwinIR',
'a1111-sd-webui-tagcomplete', 'novelai-2-local-prompt', 'OneButtonPrompt', 'openpose-editor', 'sd-canvas-editor',
'sd-webui-3d-open-pose-editor', 'sd-webui-comfyui', 'sd-webui-infinite-image-browsing', 'sd-webui-inpaint-anything',
'sd-webui-regional-prompter', 'stable-diffusion-webui-aesthetic-image-scorer',
'Stable-Diffusion-Webui-Civitai-Helper']
10:25:23-323068 INFO Verifying packages
10:25:23-327068 INFO Extension preload: 0.0s D:\AI Stuff\Vlad1111\extensions-builtin
10:25:23-328068 INFO Extension preload: 0.0s D:\AI Stuff\Vlad1111\extensions
10:25:23-335521 INFO Server arguments: ['--listen', '--comfyui-listen']
No module 'xformers'. Proceeding without it.
10:25:27-056966 INFO Pipeline: Backend.ORIGINAL
10:25:27-419001 INFO Libraries loaded
10:25:27-420002 INFO Using data path: D:\AI Stuff\Vlad1111
10:25:27-423508 INFO Available VAEs: D:\AI Stuff\Model Storage\models\VAE 5
10:25:27-462423 INFO Available models: D:\AI Stuff\Model Storage\models\Stable-diffusion 98
10:25:28-522759 INFO ControlNet v1.1.233
ControlNet v1.1.233
ControlNet preprocessor location: D:\AI Stuff\Vlad1111\extensions-builtin\sd-webui-controlnet\annotator\downloads
10:25:28-601745 INFO ControlNet v1.1.233
ControlNet v1.1.233
Tag Autocomplete: Could not locate model-keyword extension, LORA/LYCO trigger word completion will be unavailable.
[sd-webui-comfyui] restoring graceful SIGINT handler for the webui process
Civitai Helper: Get Custom Model Folder
Civitai Helper: Load setting from: D:\AI Stuff\Vlad1111\extensions\Stable-Diffusion-Webui-Civitai-Helper\setting.json
Civitai Helper: No setting file, use default
10:25:34-064803 INFO Loading UI theme: name=gradio/default style=Dark
10:25:34-103894 INFO Extra network created thumbnails: checkpoints 0
Running on local URL: http://0.0.0.0:7860
10:25:40-360323 INFO Local URL: http://localhost:7860/
10:25:40-361323 INFO Initializing middleware
[sd-webui-comfyui] started callback listeners for process webui
Loading weights: D:\AI Stuff\Model Storage\models\Stable-diffusion\bb95FurryMix_v110.safetensors ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 0.0/4.3 GB -:--:--10:25:41-246073 INFO Setting Torch parameters: dtype=torch.float16 vae=torch.float16 unet=torch.float16
LatentDiffusion: Running in eps-prediction mode
DiffusionWrapper has 859.52 M params.
[ComfyUI] [sd-webui-comfyui] started callback listeners for process comfyui
[ComfyUI] [sd-webui-comfyui] Injecting custom extensions...
[ComfyUI] Total VRAM 24564 MB, total RAM 65277 MB
Loading weights: D:\AI Stuff\Model Storage\models\VAE\vae-ft-mse-840000-ema-pruned.safetensors ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 0.0/334.6 MB -:--:--10:25:42-759007 INFO Applying scaled dot product cross attention optimization
10:25:42-790859 INFO Embeddings: loaded=28 skipped=5
10:25:42-795859 INFO Model loaded in 1.8s (load=0.3s create=0.2s apply=0.5s vae=0.5s move=0.4s)
10:25:42-984319 INFO Model load finished: {'ram': {'used': 5.32, 'total': 63.75}, 'gpu': {'used': 4.19, 'total': 23.99}, 'retries': 0,
'oom': 0} cached=0
10:25:43-449493 INFO Startup time: 20.1s (torch=2.6s gradio=0.5s libraries=1.0s scripts=6.3s onchange=0.3s ui-txt2img=0.3s ui-img2img=0.1s
ui-settings=0.2s ui-extensions=1.4s launch=4.3s app-started=0.2s checkpoint=2.8s)
[ComfyUI] Set vram state to: NORMAL_VRAM
[ComfyUI] Device: cuda:0 NVIDIA GeForce RTX 3090 Ti : native
[ComfyUI] Using pytorch cross attention
[ComfyUI] [sd-webui-comfyui] Launching ComfyUI with arguments: --listen 0.0.0.0 --port 8189
[ComfyUI]
Import times for custom nodes:
[ComfyUI] 0.0 seconds: D:\AI Stuff\Vlad1111\extensions\sd-webui-comfyui\comfyui_custom_nodes\webui_save_image.py
[ComfyUI] 0.0 seconds: D:\AI Stuff\Vlad1111\extensions\sd-webui-comfyui\comfyui_custom_nodes\webui_io.py
[ComfyUI] 0.0 seconds: D:\AI Stuff\Vlad1111\extensions\sd-webui-comfyui\comfyui_custom_nodes\webui_checkpoint_loader.py
[ComfyUI]
[ComfyUI] Starting server

11:50:16-276332 INFO Exiting
[sd-webui-comfyui] stopped callback listeners for process webui
Terminate batch job (Y/N)? y
PS D:\AI Stuff\Vlad1111> .\webui.bat --listen --comfyui-listen --webui-comfyui-client-address 0.0.0.0:8189
Using VENV: D:\AI Stuff\Vlad1111\venv
11:50:55-809512 INFO Starting SD.Next
11:50:55-815061 INFO Python 3.10.6 on Windows
11:50:55-844743 INFO Version: 9d17cf4c Mon Aug 7 19:50:39 2023 +0300
11:50:56-548215 INFO Latest published version: ff2d846667f62bd83a49b85e44e137e97c64727b
2023-08-07T21:51:23Z
11:50:56-552263 INFO nVidia CUDA toolkit detected
11:50:56-614961 WARNING Modified files: ['modules/lora', 'modules/lycoris']
11:50:56-640775 INFO Disabled extensions: ['sd-webui-agent-scheduler']
11:50:56-641777 INFO Enabled extensions-builtin: ['a1111-sd-webui-lycoris',
'clip-interrogator-ext', 'LDSR', 'Lora',
'multidiffusion-upscaler-for-automatic1111', 'ScuNET',
'sd-dynamic-thresholding', 'sd-extension-system-info',
'sd-webui-controlnet', 'stable-diffusion-webui-images-browser',
'stable-diffusion-webui-rembg', 'SwinIR']
11:50:56-643861 INFO Enabled extensions: ['a1111-sd-webui-tagcomplete',
'novelai-2-local-prompt', 'OneButtonPrompt', 'openpose-editor',
'sd-canvas-editor', 'sd-webui-3d-open-pose-editor',
'sd-webui-comfyui', 'sd-webui-infinite-image-browsing',
'sd-webui-inpaint-anything', 'sd-webui-regional-prompter',
'stable-diffusion-webui-aesthetic-image-scorer',
'Stable-Diffusion-Webui-Civitai-Helper']
11:50:56-647312 INFO Verifying requirements
11:50:56-656827 INFO Verifying packages
11:50:56-662827 INFO Verifying repositories
11:51:00-550719 INFO Verifying submodules
11:51:20-808695 INFO Extensions enabled: ['a1111-sd-webui-lycoris',
'clip-interrogator-ext', 'LDSR', 'Lora',
'multidiffusion-upscaler-for-automatic1111', 'ScuNET',
'sd-dynamic-thresholding', 'sd-extension-system-info',
'sd-webui-controlnet', 'stable-diffusion-webui-images-browser',
'stable-diffusion-webui-rembg', 'SwinIR',
'a1111-sd-webui-tagcomplete', 'novelai-2-local-prompt',
'OneButtonPrompt', 'openpose-editor', 'sd-canvas-editor',
'sd-webui-3d-open-pose-editor', 'sd-webui-comfyui',
'sd-webui-infinite-image-browsing', 'sd-webui-inpaint-anything',
'sd-webui-regional-prompter',
'stable-diffusion-webui-aesthetic-image-scorer',
'Stable-Diffusion-Webui-Civitai-Helper']
11:51:20-810921 INFO Verifying packages
11:51:20-814007 INFO Extension preload: 0.0s D:\AI Stuff\Vlad1111\extensions-builtin
11:51:20-815007 INFO Extension preload: 0.0s D:\AI Stuff\Vlad1111\extensions
11:51:20-839614 INFO Server arguments: ['--listen', '--comfyui-listen',
'--webui-comfyui-client-address', '0.0.0.0:8189']
No module 'xformers'. Proceeding without it.
11:51:25-556295 INFO Pipeline: Backend.ORIGINAL
11:51:26-390568 INFO Libraries loaded
11:51:26-391568 INFO Using data path: D:\AI Stuff\Vlad1111
11:51:26-395568 INFO Available VAEs: D:\AI Stuff\Model Storage\models\VAE 5
11:51:27-169707 INFO Available models: D:\AI Stuff\Model
Storage\models\Stable-diffusion 98
11:51:28-303101 INFO ControlNet v1.1.233
ControlNet v1.1.233
ControlNet preprocessor location: D:\AI Stuff\Vlad1111\extensions-builtin\sd-webui-controlnet\annotator\downloads
11:51:28-512422 INFO ControlNet v1.1.233
ControlNet v1.1.233
Tag Autocomplete: Could not locate model-keyword extension, LORA/LYCO trigger word completion will be unavailable.
[sd-webui-comfyui] restoring graceful SIGINT handler for the webui process
Civitai Helper: Get Custom Model Folder
Civitai Helper: Load setting from: D:\AI Stuff\Vlad1111\extensions\Stable-Diffusion-Webui-Civitai-Helper\setting.json
Civitai Helper: No setting file, use default
11:51:34-704611 INFO Loading UI theme: name=gradio/default style=Dark
11:51:35-031390 INFO Extra network created thumbnails: checkpoints 0
Running on local URL: http://0.0.0.0:7860
11:51:41-982860 INFO Local URL: http://localhost:7860/
11:51:41-984867 INFO Initializing middleware
[sd-webui-comfyui] started callback listeners for process webui
Loading weights: D:\AI Stuff\Model Storage\models\Stable-diffusion\bb95FurryMix_v110.safe…
11:51:42-875012 INFO Setting Torch parameters: dtype=torch.float16 vae=torch.float16
unet=torch.float16
LatentDiffusion: Running in eps-prediction mode
DiffusionWrapper has 859.52 M params.
[ComfyUI] [sd-webui-comfyui] started callback listeners for process comfyui
[ComfyUI] [sd-webui-comfyui] Injecting custom extensions...
[ComfyUI] Total VRAM 24564 MB, total RAM 65277 MB
Loading weights: D:\AI Stuff\Model Storage\models\VAE\vae-ft-mse-840000-ema-pruned.safete…
11:51:44-449731 INFO Applying scaled dot product cross attention optimization
11:51:44-982107 INFO Embeddings: loaded=28 skipped=5
11:51:44-986107 INFO Model loaded in 2.4s (load=0.3s create=0.2s apply=0.5s vae=0.5s
move=0.4s embeddings=0.5s)
11:51:45-176018 INFO Model load finished: {'ram': {'used': 5.31, 'total': 63.75},
'gpu': {'used': 4.19, 'total': 23.99}, 'retries': 0, 'oom': 0}
cached=0
[ComfyUI] Set vram state to: NORMAL_VRAM
[ComfyUI] Device: cuda:0 NVIDIA GeForce RTX 3090 Ti : native
[ComfyUI] Using pytorch cross attention
[ComfyUI] [sd-webui-comfyui] Launching ComfyUI with arguments: --listen 0.0.0.0 --port 8189
11:51:45-658939 INFO Startup time: 24.8s (torch=2.6s gradio=1.0s libraries=1.9s
models=0.8s scripts=7.2s onchange=0.3s ui-txt2img=1.1s
ui-img2img=0.1s ui-settings=0.2s ui-extensions=1.6s
ui-defaults=0.1s launch=4.3s app-started=0.2s checkpoint=3.4s)
[ComfyUI]
Import times for custom nodes:
[ComfyUI] 0.0 seconds: D:\AI Stuff\Vlad1111\extensions\sd-webui-comfyui\comfyui_custom_nodes\webui_save_image.py
[ComfyUI] 0.0 seconds: D:\AI Stuff\Vlad1111\extensions\sd-webui-comfyui\comfyui_custom_nodes\webui_io.py
[ComfyUI] 0.0 seconds: D:\AI Stuff\Vlad1111\extensions\sd-webui-comfyui\comfyui_custom_nodes\webui_checkpoint_loader.py
[ComfyUI]
[ComfyUI] Starting server

[ComfyUI] To see the GUI go to: http://0.0.0.0:8189

No issues with ComfyUI itself when held by SD.Next/Vlad runs perfectly, just the output in the tab does not display while using the --listen hook to push both SD.Next and ComfyUI through VPN. I have tried giving a straight IP for what the pc its hosted on is but no dice. Any help appreciated :).

For some reason, the mix of process/thread/asyncio used by the extension hangs on WSL. In particular, it seems that the thread in the comfyui process responsible for responding to webui requests hangs either here:

or here:

It is possible that it also hangs there on bare metal linux, however I do not have a machine to test it. If anybody could confirm whether it works or not, I'd appreciate it.

The initial generated image from the webui is still being saved for now.

The problem we had was that we didn't want to lose the original title or png info. The current way images are saved is not properly handled, so we kept the original images saved.

This should probably be fixed in the same PR that is going to embed the full png info of webui + comfyui in the metadata for reproducible results.

Loading an image generated with the extension should also restore the state of all used comfyui workflows.

Also, drag-and-dropping an image into a workflow should load the appropriate workflow from the metadata, but only for that workflow.

Right now, we can only update ComfyUI by going to the installation and git-pulling, which is annoying. This should be a "single button click" feature.
I'm thinking of adding it to the settings tab.
Not sure where else would be more appropriate.

To create a public link, set share=True in launch().
Startup time: 15.2s (import torch: 1.4s, import gradio: 1.0s, import ldm: 0.5s, other imports: 0.8s, setup codeformer: 0.2s, load scripts: 1.2s, load SD checkpoint: 5.0s, create ui: 0.5s, gradio launch: 4.4s).
Launching ComfyUI with arguments: --port 8188
Process SpawnProcess-1:
Traceback (most recent call last):
File "C:\Users\Administrator\AppData\Local\Programs\Python\Python310\lib\multiprocessing\process.py", line 314, in _bootstrap
self.run()
File "C:\Users\Administrator\AppData\Local\Programs\Python\Python310\lib\multiprocessing\process.py", line 108, in run
self._target(*self._args, **self._kwargs)
File "D:\stable_diffusion\stable-diffusion-webui\extensions\sd-webui-comfyui\lib_comfyui\async_comfyui_loader.py", line 13, in main
start_comfyui(comfyui_path)
File "D:\stable_diffusion\stable-diffusion-webui\extensions\sd-webui-comfyui\lib_comfyui\async_comfyui_loader.py", line 20, in start_comfyui
runpy.run_path(os.path.join(comfyui_path, "main.py"), {}, 'main')
File "C:\Users\Administrator\AppData\Local\Programs\Python\Python310\lib\runpy.py", line 288, in run_path
code, fname = _get_code_from_file(run_name, path_name)
File "C:\Users\Administrator\AppData\Local\Programs\Python\Python310\lib\runpy.py", line 252, in _get_code_from_file
with io.open_code(decoded_path) as f:
FileNotFoundError: [Errno 2] No such file or directory: 'D:\stable_diffusion\stable-diffusion-webui\extensions\sd-webui-comfyui\lib_comfyui\main.py'

in the extensions folder, the main.py in the scripts, why the error show '/lib_comfyui\main.py';
there no main.py in lib_comfyui

Opening multiple browser windows at http://localhost:7860 makes both web clients use the workflows from the last open client. Both clients should use their respective workflows, there shouldn't be any cross talk between the clients.

See https://stackoverflow.com/questions/28101895/reloading-packages-and-their-submodules-recursively-in-python for a solution. This makes it possible to reload the extension without having to completely restart the webui all the time.

I installed: stable-diffusion-webui
added this extension.

OS: Linux mint 21
python: 3.10.6
torch: 1.13.1+cu117

ComfyUI forks on its own.
SD webui works on its own.

but using ComfyUI inside SD webui after pressing "Queue prompt" gives me this error:

Exception in thread Thread-4 (prompt_worker):
Traceback (most recent call last):
  File "/usr/lib/python3.10/threading.py", line 1016, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.10/threading.py", line 953, in run
    self._target(*self._args, **self._kwargs)
  File "/media/entity/HDD/AI/ComfyUI/main.py", line 43, in prompt_worker
    e.execute(item[-2], item[-1])
  File "/media/entity/HDD/AI/ComfyUI/execution.py", line 200, in execute
    torch.cuda.ipc_collect()
  File "/media/entity/HDD/AI/stable-diffusion-webui/venv/lib/python3.10/site-packages/torch/cuda/__init__.py", line 578, in ipc_collect
    _lazy_init()
  File "/media/entity/HDD/AI/stable-diffusion-webui/venv/lib/python3.10/site-packages/torch/cuda/__init__.py", line 217, in _lazy_init
    raise RuntimeError(
RuntimeError: Cannot re-initialize CUDA in forked subprocess. To use CUDA with multiprocessing, you must use the 'spawn' start method

I have Automatic1111 running on a remote server in the building, accessible on the local network. That UI loads as expected. I can start main.py in ComfyUI with --listen [address] and then open the ComfyUI remotely as expected. I have added the path and necessary switch --listen [address] to the settings for the plugin and reloaded with successful console:

Launching ComfyUI with arguments: --listen [address] --port 8188
Total VRAM reported here
xformers version: 0.0.20
Set vram state to: NORMAL_VRAM
Device: cuda:0 GPU here
Using xformers cross attention
Starting server

To see the GUI go to: http://192.168.0.51:8188

and in this state I can see both the Automatic UI, and the ComfyUI on their relevant remote ports.

Clicking on the tab does not load the interface in either firefox or Edge.

This issue is for #2

When clicking on the "Install ComfyUI" button, in the ComfyUI tab when the install location isn't set up yet, ComfyUI doesn't show up even though it clearly started in the console:

The current node implementation systematically updates the model no matter what. I'm thinking of adding a comfyui api endpoint for sending webui model updates.

One really cool thing that could be done would be to create an alwayson script "redirect output to ComfyUI" or something like that, and then use a node "Webui Output" for using that output image. If the script is enabled, it redirects the output to ComfyUI, and starts the workflow. We could also add "Webui Save Img2Img", "Webui Save Txt2Img" and "Webui Save Extras" for outputing images in the same place as A1111 would. We could also append the workflow.json data to the image metadata to enable complex and reproduceable A1111/ComfyUi workflows.

Sometimes firefox does not render the <object> properly:

Additionally, firefox does not support the css selector :has(), which is used at the moment to hide the gradio footer when the ComfyUI tab is selected.

The last workflow I put together constantly gets overwritten in the browser local storage because auxiliary workflows (like postprocessing) also saves to the local storage.

Last update is using a new callback postprocess_batch_list that is not yet implemented in SD.Next.

We might want to make a PR in SD.Next repo.

please help, I'm a noob

The idea would be to add a "workflow manager" tab for managing ComfyUI workflows. I don't know if there's already an extension for that in ComfyUI, I just had the idea.

Add tests for:

• Downloading a fresh ComfyUI
• Running a freshly downloaded ComfyUI
• Making sure all the cmd args in ComfyUI are handled and forwarded by a1111

Running latest sd-webui-comfyui plugin in latest auto webui.
Running an Hires.fix from 512x704 to 896x1216. First run it goes through.
This works when I remove the sd-webui-confyui, every time.
Don't really know the "WebuiModelLoader node" you mentioned.
Second run and afterwards, with plugin activated even if without other nodes, just the in and out, throws in console:

100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 30/30 [00:10<00:00, 2.89it/s]
ScuNET tiles: 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 9/9 [00:00<00:00, 13.49it/s]
*** Error completing request
*** Arguments: ('task(7gfsmts5m0xwln7)', 'gorgeous cinematography, 1800s Paris, shoulder shot, (Dutch angle:1.4), post-production, depth of field, movie, cinema, professional color grading, 35mm lens, very detailed, film grain, by Tim Walker, panavision anamorphic lens effect, lora:epiNoiseoffset_v1:1, lora:AnalogDiffusion_LoRA300:.8', 'doll, 3d, cartoon, (low quality:1.5), (bad art:1.5), duplicate, multiple, disfigured, asian, middle eastern, old, ugly, child, piercing, watermark, logo, signature', [], 30, 15, False, False, 1, 1, 3, 3099757425.0, -1.0, 0, 0, 0, False, 704, 512, True, 0.25, 2, 'ScuNET', 20, 896, 1216, 1, '', '', [], <gradio.routes.Request object at 0x00000151038DE020>, 0, False, {'ad_model': 'face_yolov8n.pt', 'ad_prompt': '', 'ad_negative_prompt': '', 'ad_confidence': 0.3, 'ad_mask_min_ratio': 0, 'ad_mask_max_ratio': 1, 'ad_x_offset': 0, 'ad_y_offset': 0, 'ad_dilate_erode': 32, 'ad_mask_merge_invert': 'None', 'ad_mask_blur': 4, 'ad_denoising_strength': 0.4, 'ad_inpaint_only_masked': True, 'ad_inpaint_only_masked_padding': 32, 'ad_use_inpaint_width_height': False, 'ad_inpaint_width': 512, 'ad_inpaint_height': 512, 'ad_use_steps': False, 'ad_steps': 28, 'ad_use_cfg_scale': False, 'ad_cfg_scale': 7, 'ad_use_sampler': False, 'ad_sampler': 'Euler a', 'ad_use_noise_multiplier': False, 'ad_noise_multiplier': 1, 'ad_use_clip_skip': False, 'ad_clip_skip': 1, 'ad_restore_face': False, 'ad_controlnet_model': 'None', 'ad_controlnet_module': 'inpaint_global_harmonious', 'ad_controlnet_weight': 1, 'ad_controlnet_guidance_start': 0, 'ad_controlnet_guidance_end': 1, 'is_api': ()}, {'ad_model': 'None', 'ad_prompt': '', 'ad_negative_prompt': '', 'ad_confidence': 0.3, 'ad_mask_min_ratio': 0, 'ad_mask_max_ratio': 1, 'ad_x_offset': 0, 'ad_y_offset': 0, 'ad_dilate_erode': 32, 'ad_mask_merge_invert': 'None', 'ad_mask_blur': 4, 'ad_denoising_strength': 0.4, 'ad_inpaint_only_masked': True, 'ad_inpaint_only_masked_padding': 32, 'ad_use_inpaint_width_height': False, 'ad_inpaint_width': 512, 'ad_inpaint_height': 512, 'ad_use_steps': False, 'ad_steps': 28, 'ad_use_cfg_scale': False, 'ad_cfg_scale': 7, 'ad_use_sampler': False, 'ad_sampler': 'Euler a', 'ad_use_noise_multiplier': False, 'ad_noise_multiplier': 1, 'ad_use_clip_skip': False, 'ad_clip_skip': 1, 'ad_restore_face': False, 'ad_controlnet_model': 'None', 'ad_controlnet_module': 'inpaint_global_harmonious', 'ad_controlnet_weight': 1, 'ad_controlnet_guidance_start': 0, 'ad_controlnet_guidance_end': 1, 'is_api': ()}, False, 'MultiDiffusion', False, True, 1024, 1024, 96, 96, 48, 4, 'None', 2, False, 10, 1, 1, 64, False, False, False, False, False, 0.4, 0.4, 0.2, 0.2, '', '', 'Background', 0.2, -1.0, False, 0.4, 0.4, 0.2, 0.2, '', '', 'Background', 0.2, -1.0, False, 0.4, 0.4, 0.2, 0.2, '', '', 'Background', 0.2, -1.0, False, 0.4, 0.4, 0.2, 0.2, '', '', 'Background', 0.2, -1.0, False, 0.4, 0.4, 0.2, 0.2, '', '', 'Background', 0.2, -1.0, False, 0.4, 0.4, 0.2, 0.2, '', '', 'Background', 0.2, -1.0, False, 0.4, 0.4, 0.2, 0.2, '', '', 'Background', 0.2, -1.0, False, 0.4, 0.4, 0.2, 0.2, '', '', 'Background', 0.2, -1.0, False, 1536, 96, True, True, True, False, False, 7, True, 1, 1, 1, 100, 'Constant', 0, 'Constant', 0, 4, False, 1.6, 0.97, 0.4, 0, 20, 0, 12, '', True, False, False, False, 512, False, True, ['Face'], False, '{\n "face_detector": "RetinaFace",\n "rules": {\n "then": {\n "face_processor": "img2img",\n "mask_generator": {\n "name": "BiSeNet",\n "params": {\n "fallback_ratio": 0.1\n }\n }\n }\n }\n}', 'None', 40, False, False, 'LoRA', 'None', 0, 0, 'LoRA', 'None', 0, 0, 'LoRA', 'None', 0, 0, 'LoRA', 'None', 0, 0, 'LoRA', 'None', 0, 0, None, 'Refresh models', True, <scripts.controlnet_ui.controlnet_ui_group.UiControlNetUnit object at 0x000001507F40EB60>, <scripts.controlnet_ui.controlnet_ui_group.UiControlNetUnit object at 0x00000151037FEE00>, False, 'None', 20, False, False, 0, None, [], 0, False, [], [], False, 0, 1, False, False, 0, None, [], -2, False, [], False, 0, None, None, '', False, None, '', 'outputs', 1, 0, 0.25, False, False, 'positive', 'comma', 0, False, False, '', 'Illustration', 'svg', True, True, False, 0.5, True, 16, True, 16, False, 1, '', [], 0, '', [], 0, '', [], True, False, False, False, 0, 1.6, 0.97, 0.4, 0, 20, 0, 12, '', True, False, False, False, 512, False, True, ['Face'], False, '{\n "face_detector": "RetinaFace",\n "rules": {\n "then": {\n "face_processor": "img2img",\n "mask_generator": {\n "name": "BiSeNet",\n "params": {\n "fallback_ratio": 0.1\n }\n }\n }\n }\n}', 'None', 40, None, None, False, None, None, False, 50, True, False, 0, 'Range', 1, 'GPU', True, False, False, False, False, 0, 512, False, 512, False, False, 3, False, 3, True, 3, False, 'Horizontal', False, False, 'u2net', False, True, True, False, 0, 2.5, 'polylines_sharp', ['left-right', 'red-cyan-anaglyph'], 2, 0, '∯boost∯clipdepth∯clipdepth_far∯clipdepth_mode∯clipdepth_near∯compute_device∯do_output_depth∯gen_normalmap∯gen_rembg∯gen_simple_mesh∯gen_stereo∯model_type∯net_height∯net_size_match∯net_width∯normalmap_invert∯normalmap_post_blur∯normalmap_post_blur_kernel∯normalmap_pre_blur∯normalmap_pre_blur_kernel∯normalmap_sobel∯normalmap_sobel_kernel∯output_depth_combine∯output_depth_combine_axis∯output_depth_invert∯pre_depth_background_removal∯rembg_model∯save_background_removal_masks∯save_outputs∯simple_mesh_occlude∯simple_mesh_spherical∯stereo_balance∯stereo_divergence∯stereo_fill_algo∯stereo_modes∯stereo_offset_exponent∯stereo_separation') {}
Traceback (most recent call last):
File "D:\WORK\conda_envs\automatic\stable-diffusion-webui\modules\call_queue.py", line 58, in f
res = list(func(*args, **kwargs))
File "D:\WORK\conda_envs\automatic\stable-diffusion-webui\modules\call_queue.py", line 37, in f
res = func(*args, **kwargs)
File "D:\WORK\conda_envs\automatic\stable-diffusion-webui\modules\txt2img.py", line 62, in txt2img
processed = processing.process_images(p)
File "D:\WORK\conda_envs\automatic\stable-diffusion-webui\modules\processing.py", line 677, in process_images
res = process_images_inner(p)
File "D:\WORK\conda_envs\automatic\stable-diffusion-webui\extensions\sd-webui-controlnet\scripts\batch_hijack.py", line 42, in processing_process_images_hijack
return getattr(processing, '__controlnet_original_process_images_inner')(p, *args, **kwargs)
File "D:\WORK\conda_envs\automatic\stable-diffusion-webui\modules\processing.py", line 794, in process_images_inner
samples_ddim = p.sample(conditioning=p.c, unconditional_conditioning=p.uc, seeds=p.seeds, subseeds=p.subseeds, subseed_strength=p.subseed_strength, prompts=p.prompts)
File "D:\WORK\conda_envs\automatic\stable-diffusion-webui\extensions\sd-webui-comfyui\lib_comfyui\webui\workflow_patcher.py", line 65, in p_sample_patch
x = original_function(*args, **kwargs)
File "D:\WORK\conda_envs\automatic\stable-diffusion-webui\modules\processing.py", line 1109, in sample
samples = self.sd_model.get_first_stage_encoding(self.sd_model.encode_first_stage(decoded_samples))
File "D:\WORK\conda_envs\automatic\stable-diffusion-webui\modules\sd_hijack_utils.py", line 17, in
setattr(resolved_obj, func_path[-1], lambda *args, **kwargs: self(*args, **kwargs))
File "D:\WORK\conda_envs\automatic\stable-diffusion-webui\modules\sd_hijack_utils.py", line 28, in call
return self.__orig_func(*args, **kwargs)
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\torch\utils_contextlib.py", line 115, in decorate_context
return func(*args, **kwargs)
File "D:\WORK\conda_envs\automatic\stable-diffusion-webui\repositories\stable-diffusion-stability-ai\ldm\models\diffusion\ddpm.py", line 830, in encode_first_stage
return self.first_stage_model.encode(x)
File "D:\WORK\conda_envs\automatic\stable-diffusion-webui\repositories\stable-diffusion-stability-ai\ldm\models\autoencoder.py", line 83, in encode
h = self.encoder(x)
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\torch\nn\modules\module.py", line 1501, in _call_impl
return forward_call(*args, **kwargs)
File "D:\WORK\conda_envs\automatic\stable-diffusion-webui\repositories\stable-diffusion-stability-ai\ldm\modules\diffusionmodules\model.py", line 526, in forward
h = self.down[i_level].block[i_block](hs[-1], temb)
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\torch\nn\modules\module.py", line 1501, in _call_impl
return forward_call(*args, **kwargs)
File "D:\WORK\conda_envs\automatic\stable-diffusion-webui\repositories\stable-diffusion-stability-ai\ldm\modules\diffusionmodules\model.py", line 131, in forward
h = self.norm1(h)
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\torch\nn\modules\module.py", line 1501, in _call_impl
return forward_call(*args, **kwargs)
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\torch\nn\modules\normalization.py", line 273, in forward
return F.group_norm(
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\torch\nn\functional.py", line 2530, in group_norm
return torch.group_norm(input, num_groups, weight, bias, eps, torch.backends.cudnn.enabled)
torch.cuda.OutOfMemoryError: CUDA out of memory. Tried to allocate 540.00 MiB (GPU 0; 8.00 GiB total capacity; 6.84 GiB already allocated; 0 bytes free; 6.94 GiB reserved in total by PyTorch) If reserved memory is >> allocated memory try setting max_split_size_mb to avoid fragmentation. See documentation for Memory Management and PYTORCH_CUDA_ALLOC_CONF

Hello,

When using this plugin I get the following error after enabling the plugin, it doesn't happen immediately on install, but comfui tab doesn't show up right away so I close and restart my WSL2 Ubuntu instance and re-launch sd-webui, then I get:

Traceback (most recent call last):
  File "/home/MYUSERNAME/anaconda3/envs/automatic/lib/python3.10/multiprocessing/queues.py", line 244, in _feed
  File "/home/MYUSERNAME/anaconda3/envs/automatic/lib/python3.10/multiprocessing/reduction.py", line 51, in dumps
  File "/home/MYUSERNAME/anaconda3/envs/automatic/lib/python3.10/site-packages/torch/multiprocessing/reductions.py", line 369, in reduce_storage
RuntimeError: unable to open shared memory object </torch_1545_703365300_501> in read-write mode: Too many open files (24)

If I then try to connect to sd-webui via browser I get a string of similar errors that goes on indefinitely (could be forever but I always Ctrl+C terminal after a minute or two).

I have the following plugins installed alongside this one:
Mask2Background,SadTalker,TemporalKit,a1111-mini-paint ,a1111-sd-webui-lycoris ,a1111-sd-webui-tagcomplete ,canvas-zoom ,danbooru-prompt ,deforum-for-automatic1111-webui ,ebsynth_utility ,gif2gif ,infinite-zoom-automatic1111-webui ,model_preset_manager,multidiffusion-upscaler-for-automatic1111,sd-3dmodel-loader ,sd-canvas-editor ,sd-extension-aesthetic-scorer,sd-extension-steps-animation ,sd-webui-3d-editor,sd-webui-agent-scheduler,sd-webui-controlnet,sd-webui-infinite-image-browsing,sd-webui-llul,sd-webui-panorama-viewer ,sd-webui-regional-prompter ,sd-webui-text2video,sd-webui-txt-img-to-3d-model,stable-diffusion-NPW ,video_loopback_for_webui

Can confirm removing the ComfyUI extension folder from sd-webui/extensions returns everything to working order.

• WebuiPromptParser: generate a conditionning with the webui prompt parser (ability to use AND, BREAK, prompt editing, unprompted and other extensions, etc.)
• WebuiApi: calls the webui api with the desired input parameters. Returns an image (or a batch) that can then be used to do some postprocess in ComfyUI
• KSamplerV2, KSamplerAdvancedV2, RandomSeedGenerator, LatentNoiseGenerator: ability to select the type of noise generated, preprocess it, and then feed it to KSamplers, instead of having it hiden inside the nodes
• VisualConditionningSetArea: a node that does the same thing as ConditionningSetArea, but adds a more user-friendly ui on top of that (with dragable rectangles)

I have my Stable Diffusion "public" and was trying to have ConfyUI on it, but I can't configure the page the tab is trying to go, so it goes to the local host. is there any way I can redirect it to my domain or do I have to do a workaround?

In the machine where I am running Stable Diffusion it all works as intended.

Add a dropdown listing workflows and a button to load the current selection. The extension would discover workflows from a list of paths in the settings and when clicking on a reload button.

AUTOMATIC1111/stable-diffusion-webui#11856

It appears to me that the subprocess the extension launched has invoked modules/launch_util.py and in turn activated a start timer. This looks unexpected. Is there any way to mitigate this?

For now it is not possible to patch the webui model with lora and control clip skip, among other operations. Any action that requires the state dict is not applied at the moment.

Some tinkering needs to go into this to make it work but it should be possible to achieve.

• sdxl model
• v-prediction models
• lora state dict patching
• controlnet state dict patching

This would be in the settings for ComfyUI's location, and in the tab if ComfyUI is not found.

I used Civitai helper to install your repo, and upon reload i get this error (i used python from powershell to run install_comfyui incase that was the issue)

Error loading script: main.py
Traceback (most recent call last):
File "D:\source\StabDiffCode\stable-diffusion-webui\modules\scripts.py", line 256, in load_scripts
script_module = script_loading.load_module(scriptfile.path)
File "D:\source\StabDiffCode\stable-diffusion-webui\modules\script_loading.py", line 11, in load_module
module_spec.loader.exec_module(module)
File "", line 883, in exec_module
File "", line 241, in _call_with_frames_removed
File "D:\source\StabDiffCode\stable-diffusion-webui\extensions\sd-webui-comfyui\scripts\main.py", line 10, in
from lib_comfyui import webui_callbacks
File "D:\source\StabDiffCode\stable-diffusion-webui\extensions\sd-webui-comfyui\lib_comfyui\webui_callbacks.py", line 4, in
from lib_comfyui import comfyui_adapter, webui_tab, webui_settings
File "D:\source\StabDiffCode\stable-diffusion-webui\extensions\sd-webui-comfyui\lib_comfyui\webui_tab.py", line 70, in

File "D:\source\StabDiffCode\stable-diffusion-webui\extensions\sd-webui-comfyui\lib_comfyui\webui_settings.py", line 29, in get_port
return settings_port or shared.cmd_opts.comfyui_port
AttributeError: 'Namespace' object has no attribute 'comfyui_port'

i am guessing that for whatever reason it (automatic1111) isn't seeing your extension? Any ideas on how to fix this?

A little confused.

When using the Webui Save Image node, the first image generation works, but the following error occurs when generating images after that. If I don't use that node there is no problem.

commit : 9d01ada

Error occurred when executing KSampler:

No module named 'ldm.models.diffusion.ddpm'

File "C:\ComfyUI_windows_portable\ComfyUI\execution.py", line 151, in recursive_execute
output_data, output_ui = get_output_data(obj, input_data_all)
File "C:\ComfyUI_windows_portable\ComfyUI\execution.py", line 81, in get_output_data
return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True)
File "C:\ComfyUI_windows_portable\ComfyUI\execution.py", line 74, in map_node_over_list
results.append(getattr(obj, func)(**slice_dict(input_data_all, i)))
File "C:\ComfyUI_windows_portable\ComfyUI\nodes.py", line 1206, in sample
return common_ksampler(model, seed, steps, cfg, sampler_name, scheduler, positive, negative, latent_image, denoise=denoise)
File "C:\ComfyUI_windows_portable\ComfyUI\nodes.py", line 1167, in common_ksampler
previewer = latent_preview.get_previewer(device, model.model.latent_format)
File "C:\ComfyUI_windows_portable\ComfyUI\latent_preview.py", line 65, in get_previewer
taesd = TAESD(None, taesd_decoder_path).to(device)
File "C:\ComfyUI_windows_portable\ComfyUI\comfy\taesd\taesd.py", line 55, in init
self.decoder.load_state_dict(torch.load(decoder_path, map_location="cpu", weights_only=True))
File "C:\stable-diffusion-webui\modules\safe.py", line 108, in load
return load_with_extra(filename, *args, extra_handler=global_extra_handler, **kwargs)
File "C:\stable-diffusion-webui\modules\safe.py", line 133, in load_with_extra
from modules import shared
File "C:\stable-diffusion-webui\modules\shared.py", line 21, in
from ldm.models.diffusion.ddpm import LatentDiffusion

Traceback (most recent call last):
File "", line 1, in
File "/Users/dark/dev_lib/miniconda3/envs/sd/lib/python3.10/multiprocessing/spawn.py", line 116, in spawn_main
exitcode = _main(fd, parent_sentinel)
File "/Users/dark/dev_lib/miniconda3/envs/sd/lib/python3.10/multiprocessing/spawn.py", line 126, in _main
self = reduction.pickle.load(from_parent)
File "/Users/dark/ai_projects/stable-diffusion-webui/extensions/sd-webui-comfyui/lib_comfyui/comfyui_pre_main.py", line 5, in
from lib_comfyui import (
File "/Users/dark/ai_projects/stable-diffusion-webui/extensions/sd-webui-comfyui/lib_comfyui/argv_conversion.py", line 2, in
from lib_comfyui import webui_settings
File "/Users/dark/ai_projects/stable-diffusion-webui/extensions/sd-webui-comfyui/lib_comfyui/webui_settings.py", line 3, in
from lib_comfyui import ipc
File "/Users/dark/ai_projects/stable-diffusion-webui/extensions/sd-webui-comfyui/lib_comfyui/ipc.py", line 38, in
'webui': parallel_utils.CallbackWatcher(parallel_utils.CallbackQueue(call_fully_qualified)),
File "/Users/dark/ai_projects/stable-diffusion-webui/extensions/sd-webui-comfyui/lib_comfyui/parallel_utils.py", line 45, in init
manager = ctx.Manager()
File "/Users/dark/dev_lib/miniconda3/envs/sd/lib/python3.10/multiprocessing/context.py", line 57, in Manager
m.start()
File "/Users/dark/dev_lib/miniconda3/envs/sd/lib/python3.10/multiprocessing/managers.py", line 562, in start
self._process.start()
File "/Users/dark/dev_lib/miniconda3/envs/sd/lib/python3.10/multiprocessing/process.py", line 121, in start
self._popen = self._Popen(self)
File "/Users/dark/dev_lib/miniconda3/envs/sd/lib/python3.10/multiprocessing/context.py", line 288, in _Popen
return Popen(process_obj)
File "/Users/dark/dev_lib/miniconda3/envs/sd/lib/python3.10/multiprocessing/popen_spawn_posix.py", line 32, in init
super().init(process_obj)
File "/Users/dark/dev_lib/miniconda3/envs/sd/lib/python3.10/multiprocessing/popen_fork.py", line 19, in init
self._launch(process_obj)
File "/Users/dark/dev_lib/miniconda3/envs/sd/lib/python3.10/multiprocessing/popen_spawn_posix.py", line 42, in _launch
prep_data = spawn.get_preparation_data(process_obj._name)
File "/Users/dark/dev_lib/miniconda3/envs/sd/lib/python3.10/multiprocessing/spawn.py", line 154, in get_preparation_data
_check_not_importing_main()
File "/Users/dark/dev_lib/miniconda3/envs/sd/lib/python3.10/multiprocessing/spawn.py", line 134, in _check_not_importing_main
raise RuntimeError('''
RuntimeError:
An attempt has been made to start a new process before the
current process has finished its bootstrapping phase.

    This probably means that you are not using fork to start your
    child processes and you have forgotten to use the proper idiom
    in the main module:

        if __name__ == '__main__':
            freeze_support()
            ...

    The "freeze_support()" line can be omitted if the program
    is not going to be frozen to produce an executable.

to vladmandic fork of auto1111, its equally as popular as the main fork if not exceedingly at this point.
currently the tab sizing is incorrect and covers the vladmandic tabs when you switch to comfy.

When i tried to install the extension the following errors appeared:

As i can see its because the file "main.py" is missing, but why? its a fresh installation (i installed the extension from URL).
Also, the ComfyUI page in Automatic appears, but its totally empty.

*** Error loading script: comfyui.py
Traceback (most recent call last):
File "/root/ssd1/jhz/stable-diffusion-webui/modules/scripts.py", line 319, in load_scripts
script_module = script_loading.load_module(scriptfile.path)
File "/root/ssd1/jhz/stable-diffusion-webui/modules/script_loading.py", line 10, in load_module
module_spec.loader.exec_module(module)
File "", line 850, in exec_module
File "", line 228, in _call_with_frames_removed
File "/root/ssd1/jhz/stable-diffusion-webui/extensions/sd-webui-comfyui/scripts/comfyui.py", line 3, in
from lib_comfyui import comfyui_context, global_state, platform_utils, external_code, default_workflow_types, comfyui_process
File "/root/ssd1/jhz/stable-diffusion-webui/extensions/sd-webui-comfyui/lib_comfyui/global_state.py", line 53, in
sys.modules[name] = GlobalState(globals())
File "/root/ssd1/jhz/stable-diffusion-webui/extensions/sd-webui-comfyui/lib_comfyui/global_state.py", line 12, in init
setattr(self, k, v)
File "/root/ssd1/jhz/stable-diffusion-webui/extensions/sd-webui-comfyui/lib_comfyui/global_state.py", line 29, in setattr
GlobalState.setattr(item, value)
File "/root/ssd1/jhz/stable-diffusion-webui/extensions/sd-webui-comfyui/lib_comfyui/ipc.py", line 12, in wrapper
return function(*args, **kwargs)
TypeError: 'staticmethod' object is not callable

My head is AT 0faa28e
Thanks for your help.