Spark for Kubernetes

9/25/2019

I am designing an application which will be hosted on Azure/AWS cloud. To gain maximum value I am planning to use serverless approach. The system is performing job of ETL with different modules have specific libraries.

All of these components are using spark for data processing ( filter , map , aggregation , reporting)

I want to know how such spark based components could be deployed as FAAS ( containers) on azure/AWS ?

-- Asid
apache-spark
cloud
containers
kubernetes
serverless

0 Answers