I would like to be able to spin up a compute instance (not already created), install dependencies, run python process, tear down instance in one airflow dag.
I have come across two options:
A hacky way to do it here (this requires having code sitting in storage which is not ideal)
Are there any other ways or operators that would make this easy?