Comments (9)
It turns the clean image to the blurred one by applying Gaussian blur kernel.
from unicontrol.
Thank you for this question. The paper version model (three months ago) is only pre-trained by 9 tasks and the results demonstrated in the paper are zero-shot. This newly released 12-task checkpoint includes the supervisedly training of blurring, colorization and inpainting to ensure the stable performance on these tasks.
from unicontrol.
Thank you for your attempt. I just tested your example and tried different "control strength". It gets some better results. I guess this input image has different types of blurry compared with our synthetic blurred training data. We will deeply investigate it and may update our model to make it better.
from unicontrol.
I've encountered the same problem as well. It appears that nearly all the images that undergo deblurring retain traces of the painting's texture or mosaic-like patterns. Even when I followed the sample provided in the README.md, I couldn't achieve the desired outcome. Are there any additional suggestions or tips that I could explore?
from unicontrol.
This is weird. I guess this is caused by our limited training data which is synthesized from clean images by apply Gaussian blur kernels. Therefore, there could the domain gap between the real-world blurred images and synthetic ones. We may need to generate more training data to re-train the model. Sorry for that and thank you for letting us know. I hope this can be addressed in the next version UniControl.
from unicontrol.
Thanks for your reply. I also wanted to ask what does the condition extraction option do for the deblur task?
from unicontrol.
Greetings,
I have observed the effective performance of deblur and colorization tasks within the zero-shot context. My curiosity pertains to the alignment of the model provided in this repository with the aforementioned context. This prompts the question of whether the model has been trained without exposure to any paired data associated with the deblur and colorization tasks. This uncertainty arises from my observation that the multigen20m dataset employed in your work encompasses data relevant to both of these tasks. Your clarification on this matter would be greatly appreciated.
from unicontrol.
Thanks for your quick reply. Could you please clarify whether the model employed in the Huggingface space is the 9-task checkpoint or the 12-task checkpoint?
from unicontrol.
The HF space one is 12-task.
from unicontrol.
Related Issues (20)
- infer more then one cond control HOT 3
- Inpainting not giving faithful results HOT 1
- How to do a combination of different conditions? HOT 2
- defference between cldm_v15_unicontrol_v11.yaml and cldm_v15_unicontrol.yaml HOT 3
- what is the minimum VRAM requirement for Unicontrol? HOT 1
- we need UniControl to work with automatic1111 HOT 2
- colab demo HOT 3
- Let's train this for SDXL HOT 1
- Can't draw a mask on Inpainting tab of Gradio Demo HOT 2
- Will unicontrol support in webui? HOT 1
- This work sounds similar Uni-Controlnet, any connection? HOT 1
- How can I incorporate textual inversion into the UniControl? Will unicontrol support textual inversion? HOT 1
- How is it different from multi-controlnet? HOT 4
- Huggingface Demo ? HOT 2
- Will the training data MultiGen-20M release? HOT 4
- GPU memory for inference HOT 1
- Error when running the demo HOT 3
- 'gs://sfr-unicontrol-data-research/dataset' is not open to public HOT 1
- mult condition mult task input same time HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from unicontrol.