Is there any way to distribute tasks among pods in kubernetes. I have bunch of files on HDFS and I want to distribute them among my application pods.
Feature like Helix partition distribution will also work for me.
You probably want something like this RabbitMQ work queue example.