I've been looking into kubernetes for docker orchestration and one of my use cases is to have multiple containers spawned on different nodes, and each container needs to have read access to a list of very large files (20G+).
Because the files can be updated at times, we will be use block volume. I'm running the cluster on esxi we are limited to open source and non-cloud solutions...
By reading https://kubernetes.io/docs/concepts/storage/volumes/, seems like one of the options would be portworx. I'm wondering if there's any other better options out there?
I assume this is a pretty common use case. I'm very new to Kubernetes so any help/advice will be greatly appreciated!
look at one of the below storage solution for your cluster
First of all on Volumes, there are so many options also depends upon where your cluster is hosted (on prem or managed cloud provider?) managed cloud providers usually would have either their own option of easy mounting their block storage options e.g. Azure storage by Azure, S3 for AWS OR third party driver solutions and so on but things to know and note here:
Hope this helps