KubernetesExecutor fails to run with error OOMKilled

3/20/2020

I am experimenting Airflow KubernetesExecutor.

Airflow spawns a new Pod for each task when runs with KubernetesExecutor. the Pod gets scheduled be K8S successfully. but as soon as the Pod starts, it gets killed with OOMKilled error.

I describe the Pod before it gets killed and get the following info

    Limits:
      cpu:     50m
      memory:  100Mi
    Requests:
      cpu:     50m
      memory:  100Mi

It seems like the resource allocated to KubernetesExecutor Pod is not enough.

My question is: Is there any way I can change CPU/Mem allocated to KubernetesExecutor Pod?

-- fuyi
airflow
kubernetes
kubernetesexecutor

0 Answers