Git Product home page Git Product logo

sd-webui-fastblend's People

Contributors

artiprocher avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar

sd-webui-fastblend's Issues

这个错误怎么搞

Traceback (most recent call last):
File "/mnt/workspace/stable-diffusion-webui/venv/lib/python3.10/site-packages/gradio/routes.py", line 488, in run_predict
output = await app.get_blocks().process_api(
File "/mnt/workspace/stable-diffusion-webui/venv/lib/python3.10/site-packages/gradio/blocks.py", line 1431, in process_api
result = await self.call_function(
File "/mnt/workspace/stable-diffusion-webui/venv/lib/python3.10/site-packages/gradio/blocks.py", line 1103, in call_function
prediction = await anyio.to_thread.run_sync(
File "/mnt/workspace/stable-diffusion-webui/venv/lib/python3.10/site-packages/anyio/to_thread.py", line 33, in run_sync
return await get_asynclib().run_sync_in_worker_thread(
File "/mnt/workspace/stable-diffusion-webui/venv/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 877, in run_sync_in_worker_thread
return await future
File "/mnt/workspace/stable-diffusion-webui/venv/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 807, in run
result = context.run(func, *args)
File "/mnt/workspace/stable-diffusion-webui/venv/lib/python3.10/site-packages/gradio/utils.py", line 707, in wrapper
response = f(*args, **kwargs)
File "/mnt/workspace/stable-diffusion-webui/extensions/sd-webui-fastblend/scripts/api.py", line 650, in smooth_video
FastModeRunner().run(frames_guide, frames_style, batch_size=batch_size, window_size=window_size, ebsynth_config=ebsynth_config, save_path=frames_path)
File "/mnt/workspace/stable-diffusion-webui/extensions/sd-webui-fastblend/scripts/api.py", line 417, in run
table_l = table_manager.build_remapping_table(frames_guide, frames_style, patch_match_engine, batch_size, desc="Fast Mode Step 1/4")
File "/mnt/workspace/stable-diffusion-webui/extensions/sd-webui-fastblend/scripts/api.py", line 332, in build_remapping_table
remapping_table = [[(frames_style[i], 1)] for i in range(n)]
File "/mnt/workspace/stable-diffusion-webui/extensions/sd-webui-fastblend/scripts/api.py", line 332, in
remapping_table = [[(frames_style[i], 1)] for i in range(n)]
IndexError: list index out of range

插值后的帧会出现大片的模糊现象是什么原因呢?

我在用插值进行处理时,发现只有最后一个关键帧能够准确还原出用图生图绘制的关键,如图1和图2(图1是用您的方法,图2是图生图绘制的关键帧)。但其他关键帧都有大片的光晕或者说类似马赛克的东西,也还原不出用图生图绘制的关键帧的信息,如图3和图4(图3是插值方法,图4是图生图绘制的关键帧)。我一般是隔10帧绘制一帧关键帧,batchsize=16,32等都试过,是否追踪也都试过,都有这样的问题。请问大佬,这是什么原因,是我有什么参数没有调好吗?

image
图1

image
图2

image
图3

image
图4

sd-webui 1.6.0 启动报错

sd-webui 1.6.0 启动报错

Traceback (most recent call last):
File "D:\stable diffusion\sd-webui-aki-v4\sd-webui-aki-v4\launch.py", line 48, in
main()
File "D:\stable diffusion\sd-webui-aki-v4\sd-webui-aki-v4\launch.py", line 44, in main
start()
File "D:\stable diffusion\sd-webui-aki-v4\sd-webui-aki-v4\modules\launch_utils.py", line 436, in start
webui.webui()
File "D:\stable diffusion\sd-webui-aki-v4\sd-webui-aki-v4\webui.py", line 79, in webui
app, local_url, share_url = shared.demo.launch(
File "D:\stable diffusion\sd-webui-aki-v4\sd-webui-aki-v4\py310\lib\site-packages\gradio\blocks.py", line 1858, in launch
self.validate_queue_settings()
File "D:\stable diffusion\sd-webui-aki-v4\sd-webui-aki-v4\py310\lib\site-packages\gradio\blocks.py", line 1690, in validate_queue_settings
raise ValueError("Progress tracking requires queuing to be enabled.")
ValueError: Progress tracking requires queuing to be enabled.
提示:Python 运行时抛出了一个异常。请检查疑难解答页面。

Batch size似乎对速度影响不大?

我有大约1100帧的视频要处理,但是只有32G内存,用Fast模式无法一次性处理完,故而选择用均衡模式。
文档里面说Batch size会影响速度,默认的Batch size是8,1100帧视频大概4.5小时处理完,然而我发现默认参数下显存的利用率很低
我把Batch size改成16或者32,甚至是64,但是预期的完成时间仍然要4个多小时...
所以想提高速度就只能加大内存使用fast模式这一个办法?

Blurry result

After processing the generated frames by FastBlend, all frames became blurry. Any ideas?

cuda12.1环境下提示缺少dll

DLL dependencies:
KERNEL32.dll -> C:\Windows\System32\KERNEL32.DLL
MSVCP140.dll -> C:\Windows\SYSTEM32\MSVCP140.dll
VCRUNTIME140.dll -> D:\stable diffusion\sd-webui-aki-v4\sd-webui-aki-v4\py310\VCRUNTIME140.dll
api-ms-win-crt-convert-l1-1-0.dll -> C:\Windows\System32\ucrtbase.dll
api-ms-win-crt-environment-l1-1-0.dll -> C:\Windows\System32\ucrtbase.dll
api-ms-win-crt-filesystem-l1-1-0.dll -> C:\Windows\System32\ucrtbase.dll
api-ms-win-crt-heap-l1-1-0.dll -> C:\Windows\System32\ucrtbase.dll
api-ms-win-crt-runtime-l1-1-0.dll -> C:\Windows\System32\ucrtbase.dll
api-ms-win-crt-stdio-l1-1-0.dll -> C:\Windows\System32\ucrtbase.dll
cuTENSOR.dll -> not found
cublas64_11.dll -> not found
cudart64_110.dll -> not found
cudnn64_8.dll -> D:\stable diffusion\sd-webui-aki-v4\sd-webui-aki-v4\py310\lib\site-packages\torch\lib\cudnn64_8.dll
cufft64_10.dll -> not found
curand64_10.dll -> D:\stable diffusion\sd-webui-aki-v4\sd-webui-aki-v4\py310\lib\site-packages\torch\lib\curand64_10.dll
cusolver64_11.dll -> D:\stable diffusion\sd-webui-aki-v4\sd-webui-aki-v4\py310\lib\site-packages\torch\lib\cusolver64_11.dll
cusparse64_11.dll -> not found
nvcuda.dll -> C:\Windows\SYSTEM32\nvcuda.dll
nvrtc64_112_0.dll -> not found
python310.dll -> D:\stable diffusion\sd-webui-aki-v4\sd-webui-aki-v4\py310\python310.dll

Original error:
  ImportError: DLL load failed while importing runtime: 找不到指定的模块。

不能运行,会报错

Traceback (most recent call last):
File "D:\miaoshouai-sd-webui-v230222full\python\lib\site-packages\uvicorn\protocols\websockets\websockets_impl.py", line 238, in run_asgi
result = await self.app(self.scope, self.asgi_receive, self.asgi_send)
File "D:\miaoshouai-sd-webui-v230222full\python\lib\site-packages\uvicorn\middleware\proxy_headers.py", line 78, in call
return await self.app(scope, receive, send)
File "D:\miaoshouai-sd-webui-v230222full\python\lib\site-packages\fastapi\applications.py", line 273, in call
await super().call(scope, receive, send)
File "D:\miaoshouai-sd-webui-v230222full\python\lib\site-packages\starlette\applications.py", line 122, in call
await self.middleware_stack(scope, receive, send)
File "D:\miaoshouai-sd-webui-v230222full\python\lib\site-packages\starlette\middleware\errors.py", line 149, in call
await self.app(scope, receive, send)
File "D:\miaoshouai-sd-webui-v230222full\python\lib\site-packages\starlette\middleware\base.py", line 26, in call
await self.app(scope, receive, send)
File "D:\miaoshouai-sd-webui-v230222full\python\lib\site-packages\starlette\middleware\base.py", line 26, in call
await self.app(scope, receive, send)
File "D:\miaoshouai-sd-webui-v230222full\python\lib\site-packages\starlette\middleware\cors.py", line 76, in call
await self.app(scope, receive, send)
File "D:\miaoshouai-sd-webui-v230222full\python\lib\site-packages\starlette\middleware\gzip.py", line 26, in call
await self.app(scope, receive, send)
File "D:\miaoshouai-sd-webui-v230222full\python\lib\site-packages\starlette\middleware\exceptions.py", line 79, in call
raise exc
File "D:\miaoshouai-sd-webui-v230222full\python\lib\site-packages\starlette\middleware\exceptions.py", line 68, in call
await self.app(scope, receive, sender)
File "D:\miaoshouai-sd-webui-v230222full\python\lib\site-packages\fastapi\middleware\asyncexitstack.py", line 21, in call
raise e
File "D:\miaoshouai-sd-webui-v230222full\python\lib\site-packages\fastapi\middleware\asyncexitstack.py", line 18, in call
await self.app(scope, receive, send)
File "D:\miaoshouai-sd-webui-v230222full\python\lib\site-packages\starlette\routing.py", line 718, in call
await route.handle(scope, receive, send)
File "D:\miaoshouai-sd-webui-v230222full\python\lib\site-packages\starlette\routing.py", line 341, in handle
await self.app(scope, receive, send)
File "D:\miaoshouai-sd-webui-v230222full\python\lib\site-packages\starlette\routing.py", line 82, in app
await func(session)
File "D:\miaoshouai-sd-webui-v230222full\python\lib\site-packages\fastapi\routing.py", line 289, in app
await dependant.call(**values)
File "D:\miaoshouai-sd-webui-v230222full\python\lib\site-packages\gradio\routes.py", line 604, in join_queue
session_info = await asyncio.wait_for(
File "D:\miaoshouai-sd-webui-v230222full\python\lib\asyncio\tasks.py", line 445, in wait_for
return fut.result()
File "D:\miaoshouai-sd-webui-v230222full\python\lib\site-packages\starlette\websockets.py", line 133, in receive_json
self._raise_on_disconnect(message)
File "D:\miaoshouai-sd-webui-v230222full\python\lib\site-packages\starlette\websockets.py", line 105, in _raise_on_disconnect
raise WebSocketDisconnect(message["code"])
starlette.websockets.WebSocketDisconnect: 1001

只安装它可以么?

我没有安装SD。安装完这个工程,启动后可以访问。
但是没有Sampler: DPM++ 2M Karras,这些参数设置。
是还需要在安装SD么

Video Example

An example in interpolation mode.

video_interpolate.mp4

出现这个错误,大佬看下

Traceback (most recent call last):
File "D:\AI相关\sd-webui-aki-v4.3\python\lib\site-packages\cupy\cuda\compiler.py", line 689, in compile
nvrtc.compileProgram(self.ptr, options)
File "cupy_backends\cuda\libs\nvrtc.pyx", line 159, in cupy_backends.cuda.libs.nvrtc.compileProgram
File "cupy_backends\cuda\libs\nvrtc.pyx", line 171, in cupy_backends.cuda.libs.nvrtc.compileProgram
File "cupy_backends\cuda\libs\nvrtc.pyx", line 89, in cupy_backends.cuda.libs.nvrtc.check_status
cupy_backends.cuda.libs.nvrtc.NVRTCError: NVRTC_ERROR_COMPILATION (6)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "D:\AI相关\sd-webui-aki-v4.3\python\lib\site-packages\gradio\routes.py", line 488, in run_predict
output = await app.get_blocks().process_api(
File "D:\AI相关\sd-webui-aki-v4.3\python\lib\site-packages\gradio\blocks.py", line 1431, in process_api
result = await self.call_function(
File "D:\AI相关\sd-webui-aki-v4.3\python\lib\site-packages\gradio\blocks.py", line 1103, in call_function
prediction = await anyio.to_thread.run_sync(
File "D:\AI相关\sd-webui-aki-v4.3\python\lib\site-packages\anyio\to_thread.py", line 31, in run_sync
return await get_asynclib().run_sync_in_worker_thread(
File "D:\AI相关\sd-webui-aki-v4.3\python\lib\site-packages\anyio_backends_asyncio.py", line 937, in run_sync_in_worker_thread
return await future
File "D:\AI相关\sd-webui-aki-v4.3\python\lib\site-packages\anyio_backends_asyncio.py", line 867, in run
result = context.run(func, *args)
File "D:\AI相关\sd-webui-aki-v4.3\python\lib\site-packages\gradio\utils.py", line 707, in wrapper
response = f(*args, **kwargs)
File "D:\AI相关\sd-webui-aki-v4.3\extensions\sd-webui-fastblend\scripts\api.py", line 650, in smooth_video
FastModeRunner().run(frames_guide, frames_style, batch_size=batch_size, window_size=window_size, ebsynth_config=ebsynth_config, save_path=frames_path)
File "D:\AI相关\sd-webui-aki-v4.3\extensions\sd-webui-fastblend\scripts\api.py", line 417, in run
table_l = table_manager.build_remapping_table(frames_guide, frames_style, patch_match_engine, batch_size, desc="Fast Mode Step 1/4")
File "D:\AI相关\sd-webui-aki-v4.3\extensions\sd-webui-fastblend\scripts\api.py", line 338, in build_remapping_table
_, target_style = patch_match_engine.estimate_nnf(source_guide, target_guide, source_style)
File "D:\AI相关\sd-webui-aki-v4.3\extensions\sd-webui-fastblend\scripts\api.py", line 293, in estimate_nnf
nnf = self.initialize_nnf(source_guide.shape[0]) if level==0 else self.update_nnf(nnf, level)
File "D:\AI相关\sd-webui-aki-v4.3\extensions\sd-webui-fastblend\scripts\api.py", line 256, in initialize_nnf
cp.repeat(cp.arange(height), width).reshape(height, width),
File "D:\AI相关\sd-webui-aki-v4.3\python\lib\site-packages\cupy_creation\ranges.py", line 60, in arange
_arange_ufunc(typ(start), typ(step), ret, dtype=dtype)
File "cupy_core_kernel.pyx", line 1372, in cupy._core._kernel.ufunc.call
File "cupy_core_kernel.pyx", line 1399, in cupy._core._kernel.ufunc._get_ufunc_kernel
File "cupy_core_kernel.pyx", line 1082, in cupy._core._kernel._get_ufunc_kernel
File "cupy_core_kernel.pyx", line 94, in cupy._core._kernel._get_simple_elementwise_kernel
File "cupy_core_kernel.pyx", line 82, in cupy._core._kernel._get_simple_elementwise_kernel_from_code
File "cupy_core\core.pyx", line 2251, in cupy._core.core.compile_with_cache
File "D:\AI相关\sd-webui-aki-v4.3\python\lib\site-packages\cupy\cuda\compiler.py", line 496, in _compile_module_with_cache
return _compile_with_cache_cuda(
File "D:\AI相关\sd-webui-aki-v4.3\python\lib\site-packages\cupy\cuda\compiler.py", line 574, in _compile_with_cache_cuda
ptx, mapping = compile_using_nvrtc(
File "D:\AI相关\sd-webui-aki-v4.3\python\lib\site-packages\cupy\cuda\compiler.py", line 322, in compile_using_nvrtc
return _compile(source, options, cu_path,
File "D:\AI相关\sd-webui-aki-v4.3\python\lib\site-packages\cupy\cuda\compiler.py", line 306, in _compile
compiled_obj, mapping = prog.compile(options, log_stream)
File "D:\AI相关\sd-webui-aki-v4.3\python\lib\site-packages\cupy\cuda\compiler.py", line 708, in compile
raise CompileException(log, self.src, self.name, options,
cupy.cuda.compiler.CompileException: C:\Users\zhen\AppData\Local\Temp\tmpan7fpidl\4b5e207b198d4c8b7b55dfedb23e7c407db9253c.cubin.cu(1): catastrophic error: cannot open source file "cupy/complex.cuh"

1 catastrophic error detected in the compilation of "C:\Users\zhen\AppData\Local\Temp\tmpan7fpidl\4b5e207b198d4c8b7b55dfedb23e7c407db9253c.cubin.cu".
Compilation terminated.

使用秋叶整合包时,运行会出现这个报错,望大佬解决。

VAE weights loaded.
Traceback (most recent call last):
File "H:\SD_秋叶_4.4\sd-webui-aki\sd-webui-aki-v4.4\sd-webui-aki-v4.4\python\lib\site-packages\gradio\routes.py", line 488, in run_predict
output = await app.get_blocks().process_api(
File "H:\SD_秋叶_4.4\sd-webui-aki\sd-webui-aki-v4.4\sd-webui-aki-v4.4\python\lib\site-packages\gradio\blocks.py", line 1431, in process_api
result = await self.call_function(
File "H:\SD_秋叶_4.4\sd-webui-aki\sd-webui-aki-v4.4\sd-webui-aki-v4.4\python\lib\site-packages\gradio\blocks.py", line 1103, in call_function
prediction = await anyio.to_thread.run_sync(
File "H:\SD_秋叶_4.4\sd-webui-aki\sd-webui-aki-v4.4\sd-webui-aki-v4.4\python\lib\site-packages\anyio\to_thread.py", line 31, in run_sync
return await get_asynclib().run_sync_in_worker_thread(
File "H:\SD_秋叶_4.4\sd-webui-aki\sd-webui-aki-v4.4\sd-webui-aki-v4.4\python\lib\site-packages\anyio_backends_asyncio.py", line 937, in run_sync_in_worker_thread
return await future
File "H:\SD_秋叶_4.4\sd-webui-aki\sd-webui-aki-v4.4\sd-webui-aki-v4.4\python\lib\site-packages\anyio_backends_asyncio.py", line 867, in run
result = context.run(func, *args)
File "H:\SD_秋叶_4.4\sd-webui-aki\sd-webui-aki-v4.4\sd-webui-aki-v4.4\python\lib\site-packages\gradio\utils.py", line 707, in wrapper
response = f(*args, **kwargs)
File "H:\SD_秋叶_4.4\sd-webui-aki\sd-webui-aki-v4.4\sd-webui-aki-v4.4\extensions\sd-webui-fastblend\scripts\api.py", line 650, in smooth_video
FastModeRunner().run(frames_guide, frames_style, batch_size=batch_size, window_size=window_size, ebsynth_config=ebsynth_config, save_path=frames_path)
File "H:\SD_秋叶_4.4\sd-webui-aki\sd-webui-aki-v4.4\sd-webui-aki-v4.4\extensions\sd-webui-fastblend\scripts\api.py", line 417, in run
table_l = table_manager.build_remapping_table(frames_guide, frames_style, patch_match_engine, batch_size, desc="Fast Mode Step 1/4")
File "H:\SD_秋叶_4.4\sd-webui-aki\sd-webui-aki-v4.4\sd-webui-aki-v4.4\extensions\sd-webui-fastblend\scripts\api.py", line 332, in build_remapping_table
remapping_table = [[(frames_style[i], 1)] for i in range(n)]
File "H:\SD_秋叶_4.4\sd-webui-aki\sd-webui-aki-v4.4\sd-webui-aki-v4.4\extensions\sd-webui-fastblend\scripts\api.py", line 332, in
remapping_table = [[(frames_style[i], 1)] for i in range(n)]
IndexError: list index out of range
提示:Python 运行时抛出了一个异常。请检查疑难解答页面。

Video example

Comparison of CoDeF and FastBlend.

video_codef.mp4

太慢了

机器配置4090,18秒1080p的视频渲染了2个小时还停留在50%,是我的设置有问题吗?

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.