Add possibility to set an infinite number of retries (-1) and move the retry logic to the Executor about kestra HOT 8 CLOSED

thx for the issue, we'll investigate - it seems doable 👍

from kestra.

Discussed it internally: it's possible but we need to make the retry logic at the executor level (and no more at the worker level)

from kestra.

After investigation, we will not support infinite retries because it's really dangerous for Kestra. In Kestra, each attempts will be append on Execution, and large execution could lead to large performance issues (ui, executor, ...).
Each Circuit breakers implementation have a default value for max retry to avoid this unexpected behavior.
You could setup to a very large amount to emulate almost unlimited retry at your own risk.

from kestra.

Makes sense to me, thanks for considering it.

from kestra.

@anna-geller looks like a lot a do while for me!

from kestra.

@Skraye yup the outcome might be similar while staying more declarative (a while loop in YAML is not something we'd prioritize for now)

This one is definitely a nice and simple addition

from kestra.

@Skraye, adding this to 0.16 only in case this is something that would be easy to tackle in bulk with all other retries enhancements you are working on; if complex, feel free to move to 0.17

from kestra.

@dantimofte we are working on adding a While Loop task that seem very similar to what you're trying to accomplish - can you confirm whether while loop will solve the issue for you #3024? if so, we could close this issue

from kestra.