Re:Cloud Filestore, high-performance file storage for GCP users
by toomuchtodo on Tuesday June 26, 2018 @04:09PM
(#17403613)
We’ve seen horrendous performance on EFS unless you’ve provisioned quite a bit of storage on the volume.
[ Parent
| on HN ]
Re:Cloud Filestore, high-performance file storage for GCP users
by X-Istence on Tuesday June 26, 2018 @05:43PM
(#17404230)
Even if you have quite a bit of storage. ~40TB on EFS, and yet performance is abysmal due to the access time being about ~3ms.
So large files work well, but if you have many smaller files it's killer.
We built our app to do caching locally into NVMe drives though, so we async pull data from EFS and push back as necessary.
Definitely going to give Filestore a spin and see if it is a good fit for our use cases.
Re:Cloud Filestore, high-performance file storage for GCP users
by stonewhite on Tuesday June 26, 2018 @04:40PM
(#17403819)
Underlying S3 bits do bite you when you deal with lots of small files. Our team even considered maintaining NFS or Gluster servers over horrible EFS performance.
Re:Cloud Filestore, high-performance file storage for GCP users
by objectivefs on Tuesday June 26, 2018 @05:49PM
(#17404269)
Another file system that works well with lots of small files and that doesn't require maintaining any extra servers is ObjectiveFS[0]. It is a FUSE based log structured file system (with snapshots) using GCS or S3 for log storage with memory cache and (optional) disk cache for performance.