Running flink job on kubernetes

6/22/2018

I am trying out flink job on kubernetes with latest version of flink 1.5.

Flink on Kubernetes document defines how to deploy flink and I used minikube in mac. The flink ui comes up nicely showing the job manager and task manager.

The question I have is how to run a example app on the above flink cluster. The flink example project has information how to build a docker image with flink app and submit that application to flink. I followed the example, just changed version of flink to latest. I find the application (example-app) is submitted successfully and shows in pod in kubernetes, but the flink UI does not show any running jobs. Can someone please point me to an example of how to submit a flink job to flink cluster running on kubernetes.

-- balaji
apache-flink
kubernetes

1 Answer

6/24/2018

There is a problem with Minikube's VM that a pod cannot reference a service pointing to itself. Here is the corresponding issue.

You have to log into the Minikube VM to set the proper ip link. The following command should do the trick

minikube ssh 'sudo ip link set docker0 promisc on'

The reason why we need this is because the web submission handler which runs on the cluster entrypoint needs to connect to the cluster entrypoint to submit the job.

-- Till Rohrmann
Source: StackOverflow