Im running elastic 7.4 entirely on a kubernetes cluster (5 data / ingest nodes and 1 master). I want to move the master node to an external VM so I don't have to bounce the whole elastic setup every time I want to work on the master node. (This will give the master node a fixed IP and more resilient storage).

When I bring up the data nodes (on k8) they can find the master node on its VM but the master node doesn't seem to be able to return the favor. As a result the startup process times out.

Elastic apparently needs port 9300 exposed on every data / ingest node so Im wondering if this is the underlying issue. I would need this port available on every data / ingest node independently so the typical k8 solutions of a loadbalancer or nodeport won't work. Port-forwarding only applies to a single host and seems more like a debugging process.

Wondering if there is a way to make this hybrid setup work.