I am designing an app where user submits a file, which will be processed on a pod and will return back the details via rest api call. I have been using AWS and will user EKS for this. The flow is somewhat:
File Uploaded -> Added to Docker Container while build and pushed to registry -> Kube API will create a new node and run the pod in that node -> After scanning, return back the results to server using Auth Headers -> Drop node from cluster
I started using EKS along with Cloudformation but had to give hard coded values of scaling, but this app can have nodes ranging from 1 - 100. And, I am not able to understand how to add or remove nodes from Cloudformation and EKS via SDK. I am currently using eksctl.