How do you deploy Airflow on Kubernetes with a pvc for DAGs?

5/28/2020

I'm having uses with my dags showing up in the worker pods. The dags are persisted in the master pod but they don't show up in the worker pods. These are the settings in airflow.cfg:

dags_in_image = False

For either git sync or volume mounted DAGs, the worker will look in this subpath for DAGs

dags_volume_subpath = airflow/dags

For DAGs mounted via a volume claim (mutually exclusive with git-sync and host path)

dags_volume_claim = airflowdev-dags

-- spanneer
airflow
kubernetes

0 Answers