How to use DockerOperator from Airflow in Kubernetes

5/30/2018

from this example. DockerOperator has the docker_url parameter which is "URL of the host running the docker daemon.".

But when i run in Kubernetes engine on Google Cloud Platform, how can i find this docker_url on Kubernetes?

-- prideloki
airflow
google-kubernetes-engine
kubernetes

1 Answer

6/22/2018

You can run the following command to find out the docker url:

$docker-machine url [docker_machine_name]

Docker machine is not installed on the container images by default. You will have to install docker-machine manually by following these steps.

You will also have to use the Ubuntu image if you would like this functionality. I tried to install docker machine using a cos image, and it does not work since the image does not have the necessary dependencies.

-- Jason
Source: StackOverflow