This document describes options for running parallel jobs. The one I'm interested in is "Single job with static work assignment" Where I would create a job, set parallelism > 0 and completions == count of my work items. The problem is, I don't know how would the pods know which item they should process? environment variables look identical... not sure if k8s passes some sequence number I can use... ideas?
The best approach in your case is to use some MQ services. Your actions order may be the next:
Here you can find the latest documentation on Job Patterns. Also look at kube examples that you can find here and here. In these examples/tasks, Kubernetes uses RabbitMQ.