Comments (5)
Oh maybe append new line doesn't work for prompts, so append file with leading comma.
from clip-interrogator.
Are you running with the --lowvram
option? In theory should be able to work on 6GB no problem (CLIP Interrogator just needs 2.5GB) but I didn't sort out yet how to also kick the diffusion model out of VRAM and load it back in so the rest of the UI keeps working.
With lowvram option it is indeed only loading one model at a time on the CLIP Interrogator side and swapping it out for the next one. The main diffusion model is eating up a lot though which is the issue currently.
from clip-interrogator.
oh I'll have to try that on the next batch of x thousands images.
Where do I put the --lowvram option?
I was using A1111 didn't realize there was a different git for that.
from clip-interrogator.
Is it possible to run this on actually low vram? My card only has 2 and it just fails to work, even if I run webui with --lowvram flag
from clip-interrogator.
torch.cuda.OutOfMemoryError: CUDA out of memory. Tried to allocate 6.76 GiB (GPU 0; 23.99 GiB total capacity; 18.50 GiB already allocated; 2.45 GiB free; 18.56 GiB reserved in total by PyTorch) If reserved memory is >> allocated memory try setting max_split_size_mb to avoid fragmentation. See documentation for Memory Management and PYTORCH_CUDA_ALLOC_CONF
Is there a bug in the code's memory allocation management? Even running the program on a 4090 graphics card results in an out-of-memory error
from clip-interrogator.
Related Issues (20)
- Only keeping flavors.txt and removing other data files HOT 1
- Clip Interrogator EXT issue - incorrect prompt
- Interrogator 1: RuntimeError: The size of tensor a (3) must match the size of tensor b (9) at non-singleton dimension 0
- How to speed up? Which torch version is suggested HOT 3
- How to set lowvram mode on via settings?
- two errors
- Prompt generation issiue
- timing interrogation
- Is there any way to only return caption without tag
- Error occurred when executing ClipInterrogator: Remote end closed connection without response HOT 1
- How to set interrogation mode when used in another script?
- cannot find python: which version HOT 1
- Are there any expansion plans for comfyui? HOT 6
- run_cli.py just freezes? import open_clip freezes? HOT 1
- Exception <class 'RuntimeError'> HOT 4
- Does clip-interrogator have built-in queue processing? HOT 1
- Downloads BLIP Checkpoint every time HOT 2
- What does "Ranking against your own list of terms?" mean?
- SD crashed after install CLIP, how to fix it or remove it?
- Loading flavors.txt is very slow HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from clip-interrogator.