Git Product home page Git Product logo

Comments (5)

udgigor avatar udgigor commented on June 3, 2024

Oh maybe append new line doesn't work for prompts, so append file with leading comma.

from clip-interrogator.

pharmapsychotic avatar pharmapsychotic commented on June 3, 2024

Are you running with the --lowvram option? In theory should be able to work on 6GB no problem (CLIP Interrogator just needs 2.5GB) but I didn't sort out yet how to also kick the diffusion model out of VRAM and load it back in so the rest of the UI keeps working.
With lowvram option it is indeed only loading one model at a time on the CLIP Interrogator side and swapping it out for the next one. The main diffusion model is eating up a lot though which is the issue currently.

from clip-interrogator.

udgigor avatar udgigor commented on June 3, 2024

oh I'll have to try that on the next batch of x thousands images.
Where do I put the --lowvram option?
I was using A1111 didn't realize there was a different git for that.

from clip-interrogator.

Arctomachine avatar Arctomachine commented on June 3, 2024

Is it possible to run this on actually low vram? My card only has 2 and it just fails to work, even if I run webui with --lowvram flag

from clip-interrogator.

seasnakes avatar seasnakes commented on June 3, 2024

torch.cuda.OutOfMemoryError: CUDA out of memory. Tried to allocate 6.76 GiB (GPU 0; 23.99 GiB total capacity; 18.50 GiB already allocated; 2.45 GiB free; 18.56 GiB reserved in total by PyTorch) If reserved memory is >> allocated memory try setting max_split_size_mb to avoid fragmentation. See documentation for Memory Management and PYTORCH_CUDA_ALLOC_CONF

Is there a bug in the code's memory allocation management? Even running the program on a 4090 graphics card results in an out-of-memory error

from clip-interrogator.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.