Docker image is taking too much time to build about worker-vllm HOT 7 CLOSED

Just pushed an update to address this, let me know if you’re still facing the issue

from worker-vllm.

Yes, that’s the one. My sincere apologies!

from worker-vllm.

I will try! Thanks for your help!

from worker-vllm.

Just pushed an update to address this, let me know if you’re still facing the issue

5aecb62

It seems like wrong branch name

Do you mean old-11.8 and old-12.1 ?

from worker-vllm.

Still take too much time :(((

from worker-vllm.

Try adding something like this before the build and adjust the values based on your system:

ENV MAX_JOBS=48 # The number of CPU cores you have
ENV NVCC_THREADS=1024 # Changes depending on GPU

from worker-vllm.

Try out 0.2.0, you no longer need to compile vLLM, so the build should be very fast.

from worker-vllm.