Git Product home page Git Product logo

Comments (14)

schananas avatar schananas commented on July 18, 2024 4

did someone managed to make tutorial for cross image region drag and merge? really curious to try out this functionality

from editanything.

ennnnny avatar ennnnny commented on July 18, 2024 2

Curious about the effect of "Cross-Image region drag and merge".
I tried to run it in google colab and found that the memory exceeded 12G causing the startup to fail, and there may be a problem with environment.yaml.
It would be great if could provide a google colab configuration!πŸ˜€

from editanything.

ennnnny avatar ennnnny commented on July 18, 2024 2

Curious about the effect of "Cross-Image region drag and merge". I tried to run it in google colab and found that the memory exceeded 12G causing the startup to fail, and there may be a problem with environment.yaml. It would be great if could provide a google colab configuration!πŸ˜€

Other extra modules like BLIP model and SAM model may cost some GPU memory. You can extract ths function

x_samples = self.pipe(

to use the cross-image drag in the google colab. This would aovid the OOM problem I suppose.

Screenshot 2023-06-30 at 10 08 11 AM I am also getting issues. I have attached the [collab](https://colab.research.google.com/drive/1eLnlD8ACvzawbBX7vUPlHU6a9f_Tn0Vz?usp=sharing) here. Really appreciate your help !

You can try my https://github.com/ennnnny/sd_colab/blob/self/editanything.ipynb but I haven't solved the OOM problem. Maybe the colab Pro account can perform.

from editanything.

gasvn avatar gasvn commented on July 18, 2024 1

To reproduce our results, you can launch the editany_test.py And there is a reference tab in the grdio demo. You can update the image in reference tab then select the region you want to drag. We will update the readme file, thanks.

The environment required by editany_test.py is not consistent with environment.yaml (for example, running editany_test.py with the environment installed by environment.yaml will report multiple errors such as such as missing xformers and diffusers versions), please update the readme file as soon as possible. Thanks for your contribution!

Thanks for the feedback, I have updated the packages in environment.yaml. Please let me know if you still encounter errors.

from editanything.

gasvn avatar gasvn commented on July 18, 2024

To reproduce our results, you can launch the editany_test.py And there is a reference tab in the grdio demo. You can update the image in reference tab then select the region you want to drag. We will update the readme file, thanks.

from editanything.

Guanyuansheng avatar Guanyuansheng commented on July 18, 2024

To reproduce our results, you can launch the editany_test.py And there is a reference tab in the grdio demo. You can update the image in reference tab then select the region you want to drag. We will update the readme file, thanks.

The environment required by editany_test.py is not consistent with environment.yaml (for example, running editany_test.py with the environment installed by environment.yaml will report multiple errors such as such as missing xformers and diffusers versions), please update the readme file as soon as possible. Thanks for your contribution!

from editanything.

gasvn avatar gasvn commented on July 18, 2024

Curious about the effect of "Cross-Image region drag and merge". I tried to run it in google colab and found that the memory exceeded 12G causing the startup to fail, and there may be a problem with environment.yaml. It would be great if could provide a google colab configuration!πŸ˜€

Other extra modules like BLIP model and SAM model may cost some GPU memory. You can extract ths function

x_samples = self.pipe(
to use the cross-image drag in the google colab. This would aovid the OOM problem I suppose.

from editanything.

gamingflexer avatar gamingflexer commented on July 18, 2024

Curious about the effect of "Cross-Image region drag and merge". I tried to run it in google colab and found that the memory exceeded 12G causing the startup to fail, and there may be a problem with environment.yaml. It would be great if could provide a google colab configuration!πŸ˜€

Other extra modules like BLIP model and SAM model may cost some GPU memory. You can extract ths function

x_samples = self.pipe(

to use the cross-image drag in the google colab. This would aovid the OOM problem I suppose.

Screenshot 2023-06-30 at 10 08 11 AM

I am also getting issues. I have attached the collab here.
Really appreciate your help !

from editanything.

ennnnny avatar ennnnny commented on July 18, 2024

Curious about the effect of "Cross-Image region drag and merge". I tried to run it in google colab and found that the memory exceeded 12G causing the startup to fail, and there may be a problem with environment.yaml. It would be great if could provide a google colab configuration!πŸ˜€

Other extra modules like BLIP model and SAM model may cost some GPU memory. You can extract ths function

x_samples = self.pipe(

to use the cross-image drag in the google colab. This would aovid the OOM problem I suppose.

environment.yaml need safetensors>=0.3.1

Thanks for the update! I tested it on a 3080Ti graphics card with 32G RAM machine and was able to run it, but the generated graphs were very resource intensive. Tried several times and failed to achieve similar results as the demo. Hopefully a more detailed tutorial on how to do this will follow.

from editanything.

gamingflexer avatar gamingflexer commented on July 18, 2024

Curious about the effect of "Cross-Image region drag and merge". I tried to run it in google colab and found that the memory exceeded 12G causing the startup to fail, and there may be a problem with environment.yaml. It would be great if could provide a google colab configuration!πŸ˜€

Other extra modules like BLIP model and SAM model may cost some GPU memory. You can extract ths function

x_samples = self.pipe(

to use the cross-image drag in the google colab. This would aovid the OOM problem I suppose.

Screenshot 2023-06-30 at 10 08 11 AM I am also getting issues. I have attached the [collab](https://colab.research.google.com/drive/1eLnlD8ACvzawbBX7vUPlHU6a9f_Tn0Vz?usp=sharing) here. Really appreciate your help !

You can try my https://github.com/ennnnny/sd_colab/blob/self/editanything.ipynb but I haven't solved the OOM problem. Maybe the colab Pro account can perform.

Thanks will look into it !

from editanything.

gasvn avatar gasvn commented on July 18, 2024

https://github.com/ennnnny/sd_colab/blob/self/editanything.ipynb

Curious about the effect of "Cross-Image region drag and merge". I tried to run it in google colab and found that the memory exceeded 12G causing the startup to fail, and there may be a problem with environment.yaml. It would be great if could provide a google colab configuration!πŸ˜€

Other extra modules like BLIP model and SAM model may cost some GPU memory. You can extract ths function

x_samples = self.pipe(

to use the cross-image drag in the google colab. This would aovid the OOM problem I suppose.

environment.yaml need safetensors>=0.3.1

Thanks for the update! I tested it on a 3080Ti graphics card with 32G RAM machine and was able to run it, but the generated graphs were very resource intensive. Tried several times and failed to achieve similar results as the demo. Hopefully a more detailed tutorial on how to do this will follow.

As this solution is training-free, you need to adjust the parameters to get the good results. Also, I find that the text prompt is important. If you cannot get a good description of your reference region, you can train the reference region with text inversion to get a good text embedding. I will upload a tutorial, thanks for your advice.

from editanything.

gamingflexer avatar gamingflexer commented on July 18, 2024

https://github.com/ennnnny/sd_colab/blob/self/editanything.ipynb

Curious about the effect of "Cross-Image region drag and merge". I tried to run it in google colab and found that the memory exceeded 12G causing the startup to fail, and there may be a problem with environment.yaml. It would be great if could provide a google colab configuration!πŸ˜€

Other extra modules like BLIP model and SAM model may cost some GPU memory. You can extract ths function

x_samples = self.pipe(

to use the cross-image drag in the google colab. This would aovid the OOM problem I suppose.

environment.yaml need safetensors>=0.3.1
Thanks for the update! I tested it on a 3080Ti graphics card with 32G RAM machine and was able to run it, but the generated graphs were very resource intensive. Tried several times and failed to achieve similar results as the demo. Hopefully a more detailed tutorial on how to do this will follow.

As this solution is training-free, you need to adjust the parameters to get the good results. Also, I find that the text prompt is important. If you cannot get a good description of your reference region, you can train the reference region with text inversion to get a good text embedding. I will upload a tutorial, thanks for your advice.

Results were not that great but hopefully your tutorial can help us !

Tutorial for this would be great. Thanks waiting for it : )

from editanything.

ZhouYaoxue avatar ZhouYaoxue commented on July 18, 2024

the "Cross-image region drag and merge" is great, but which files can i read to know how it works

from editanything.

zhengyi0533 avatar zhengyi0533 commented on July 18, 2024

How to use it with controlnet?

from editanything.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    πŸ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. πŸ“ŠπŸ“ˆπŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❀️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.