[Bug]: Outlines json guided decoding about aphrodite-engine HOT 7 OPEN

it's a privilege issue, fixed running chmod 777 -R * inside /app/aphrodite-engine/.cache

from aphrodite-engine.

if useful for someone with the same issue, workarround:

docker exec -u root "container_name" -R 777 /app/aphrodite-engine/.cache

from aphrodite-engine.

please 🙏, it's a simple bug but adds a lot of value, it practically kill all the previous effort of json guided decoding @AlpinDale 🙏 and in every production release we have to enter inside the container to fix it =(

from aphrodite-engine.

Hi sorry, I totally missed this issue! Can you run the docker in privileged mode?

from aphrodite-engine.

thats a good idea, I cannot run permanently in that mode, but I can handle that for a while, thanks!

from aphrodite-engine.

We already resolved a similar issue related to triton - it should be fixed in the latest docker. Have you tried it?

from aphrodite-engine.

i'm trying the last official image, still has the problem, and now I got another problem with moes with the last version, have create the other issue. (sorry for reporting so many bugs, I use a lot your engine)

from aphrodite-engine.