How to debug Airflow on Kubernetes Executor?

5/8/2020

I am new to Airflow. I just deployed Airflow on k8s (running on AWS using KOPS) using helm. I see web server, Postgres, tiller, and scheduler pod running. I am also able to access web server locally using port forwarding. When I trigger the DAG, they stop at queue n don't go any further don't see any errors, not sure how to debug this. I was able to run this successfully on minikube locally. Please advice.

k8s version: Client Version: version.Info{Major:"1", Minor:"18", GitVersion:"v1.18.2"} Server Version: version.Info{Major:"1", Minor:"15", GitVersion:"v1.15.7"}

helm version: 2.16.1 executor is set to kubernetes executor both config maps and airflow.cfg

-- Vinay Emmaadii
airflow
airflow-scheduler
kubernetesexecutor

0 Answers