Sync all workers upon completion of all jobs

8/30/2019

I have a kubernetes cluster which processes a series of jobs creating result files. I would like to sync these results to an S3 folder upon completion of all jobs. Is there a way to schedule an S3 sync after all jobs have been completed then shut down all of the instances in the cluster?

-- Morgan Gladden
amazon-web-services
kubernetes

1 Answer

8/31/2019

I can think of 2 ways you can put the result files in s3.

-- Tummala Dhanvi
Source: StackOverflow