Is there a "queue is empty" hook? about beaneater HOT 9 CLOSED

I don't think there is, but in my scenario which sounds similar I just make a reserve request for the tube with a short timeout and check the return. If I get a TIMED_OUT response it means it was empty. I suppose you could peek, but then you would be looping.

from beaneater.

and how do you handle buried jobs? I suppose you should kick them all before declaring the tube empty when you get a TIMED_OUT response.

from beaneater.

I don't have buried jobs in my scenario, but a peek-buried or a kick on TIMED_OUT makes sense.

from beaneater.

I "solved" by creating a queue that monitors other queues. A bit "meta", but it works :)

from beaneater.

Yes, but do you have a queue to monitor the monitor queue? :)

from beaneater.

queue monitor is always there. if the monitored queue is empty the task gets archived, otherwise recreated with the same params and some delay.

from beaneater.

Stumbled upon a nasty situation. Monitor task detects a queue is empty and starts a very long upload task. I assume this will not be called anymore and it's the last operation to be performed on the queue, but for some reason a worker sometimes kicks in on exactly the same task I am performing (the upload) and starts to upload the same file again. Any hint?

from beaneater.

Uhm, I am gonna try to increase the ttr to 1800 and see how it goes.

from beaneater.

Ok, increasing a lot the ttr worked but I had to use a pretty complex if to make sure the queue is really not empty

if tube.stats.current_jobs_urgent > 0 || tube.stats.current_jobs_ready > 0 || tube.stats.current_jobs_reserved > 0 || tube.stats.current_jobs_delayed > 0 || tube.stats.current_jobs_buried > 0 || tube.stats.current_using > 0

Just peeking :ready, :buried and :delayed does not work for me.

from beaneater.