What is the best way to run a python process on a separate compute instance with Google Cloud Composer?

1/8/2020

I would like to be able to spin up a compute instance (not already created), install dependencies, run python process, tear down instance in one airflow dag.

I have come across two options:

Are there any other ways or operators that would make this easy?

-- user3408780
airflow
google-cloud-composer
google-cloud-platform
google-kubernetes-engine
kubernetes

0 Answers