Send logs to s3 - Official Airflow Helm Chart + KubernetesExecutor

11/9/2021

I'm using the official Airflow Helm Chart to deploy KubernetesExecutor (still locally) on a KinD Cluster.

Because this is a Helm Chart, I'm having a lot of trouble trying to configure anything that are not explicitly shown at the documentation.

Using this scenario, I want to send all my logs data produced by my DAGs to a s3 bucket (which is a common thing to do on the airflow stack).

The problem is: there's nothing on the documentation and even on other threads that can help me achieve this.

Is there anything that I can do?

-- Jorge Nachtigall
airflow
amazon-s3
kubernetes
kubernetes-helm

0 Answers