Uses cases and testimonials about kubernetesjoboperator HOT 3 OPEN

@barloc Actually, that should already be happening, the logging from the pod should be directed to your log files. If you are having issues seeing the logs, there is either a bug in the pod log collector or your airflow implementation.

At this point I will shamelessly plug-in my own airflow plugins,

The logger (https://github.com/LamaAni/AirflowDBLogger) logs to the database instead of files in the airflow task. This removes usually most of the logging issues with airflow.

I also have a full k8s airflow deployment which focuses on Kubernetes. I developed it for easier work with my clients. Its here: https://github.com/LamaAni/zairflow

For any more questions, lets move this to an issue!

from kubernetesjoboperator.

Hello
Thanx for your operator, it is very useful in our environment.
But we have a trouble with jobs logs getting because don't have ELK or other logging system for our k8s installation.
How you think it is difficult to get logs from the pod and write it to the airflow task log?

from kubernetesjoboperator.

The logger (https://github.com/LamaAni/AirflowDBLogger) logs to the database instead of files in the airflow task. This removes usually most of the logging issues with airflow.

Oh, it is great thing. I try to use it, thank you.

Actually, that should already be happening, the logging from the pod should be directed to your log files. If you are having issues seeing the logs, there is either a bug in the pod log collector or your airflow implementation.

Hmm. I checked it again, but saw only logs of the operator, not pod :( I try to investigate why and return with issue or pr, thank you.

from kubernetesjoboperator.