So I have no idea what would work for you and am not in a position to make a solid recommendation.... buuuut this is the internet so I'll list some possibilities in order of perceived production worthiness:

- Good ol' trusty NFS[0][1] (of course someone has to take an arrow to the knee and become an NFS admin essentially)

- CephFS[2] via Rook Shared filesystem[3]

- Swift[4] though it looks like a huge PITA to deploy outside of openstack, almost like it's hard on purpose

- Dragonfly[5]? I remember think of it for containers but it's technically for random files too

- SeaweedFS[6]? It's got a comparison section which is a good sign??

- Could you just... offload to some S3-like thing?

[0]: https://kubernetesguide.com/kubernetes/nfs-volumes-in-kubern...

[1]: https://www.padok.fr/en/blog/readwritemany-nfs-kubernetes

[2]: https://docs.ceph.com/en/latest/cephfs/

[3]: https://rook.io/docs/rook/v1.4/ceph-filesystem-crd.html

[4]: https://docs.openstack.org/swift

[5]: https://github.com/dragonflyoss/Dragonfly

[6]: https://github.com/chrislusf/seaweedfs#compared-to-other-fil...

Oh wow thanks for taking the time and writing this up ! Lol agreed with NFS. Trying to avoid that yes. I think I will need to setup some tests and go from there.

Thanks again !