Errors.CloseTimeout (Close operation timed out) about piscina HOT 2 CLOSED

Hi @metcoder95,

Thanks for your quick response!
I already saw the drain event but my main goal is to wait for all elements are executed completely. Now I just implemented a workaround:
I introduced a global variable finished as counter. Within the task argument of the piscina.run call I increment the counter. So I'm sure that each task has been finished and after that the counter is incremented. Next to the for-loop of the piscina.run calls I added following (with maxLength == 20 in my example above):

while (finished != maxLength)
{
  await Sleep(100);
}

So every 100 ms I check whether my counter reached my max element size and thus I can detect that all tasks have been executed completely.

For me this issue is closed. Thanks again for your response! 😄

from piscina.

Hey!

First, yes, as you already said the erro is working as expected; the close method won't wait for the queue to be flushed but rather that all running tasks are done before closing. Tho, the event is quite interesting because it might mean that something is causing the worker to report back the state in a delayed manner.

Second, not sure what your main goal is, but if you are seeking to see when its time to add more tasks to the queue, I'd definitely suggest you to use the drain event from Piscina.
e.g.

const { once } = require('node:event');

// Piscina code
await once(piscina, 'drain');

This event is triggered when the pool has room capacity for adding more tasks.

What I acknowledge is that we do not have an event for when pool and its task queue is totally empty, maybe adding something like idle event can be of support.

from piscina.