Flink in Kubernetes. How to add submit job step to jobmanager flink docker?

7/27/2018

I use Flink with K8s. Everything works fine, but I have to submit jar manually when jobmanager is up.

I think we can extend flink image and add post action to submit job. So jobmanager will be one for one flink job. I think it was the idea from https://www.youtube.com/watch?v=w721NI-mtAA

In this case if JM is down, K8s will up new pod and resubmit the job.

Am I right?

Does anyone have such docker changes for flink?

-- Aleksandr Filichkin
apache-flink
flink-streaming
java
kubernetes
streaming

1 Answer

7/27/2018

I solved this stuff.

I extend flink Docker and added "Flink run "some.jar"" step to it.

It works perfect

https://github.com/Aleksandr-Filichkin/flink-k8s

-- Aleksandr Filichkin
Source: StackOverflow