BeeGFS, the Parallel Cluster File System

Re:BeeGFS, the Parallel Cluster File System by sharktour on Wednesday February 24, 2016 @08:40AM (#11166586)

This doesn't fill the huge gap for Cloud NAS. GlusterFS is hugely complicated and a fragile install, SoftNAS has (anecdotally) poor performance on high-io... but it's closer. Amazon hasn't launched their EFS product to General Availability Yet.

So wtf do we do when we need a 5TB shared storage platform across some EC2 nodes?

[ Parent | on HN ]

Re:BeeGFS, the Parallel Cluster File System by illumin8 on Wednesday February 24, 2016 @12:07PM (#11168281)

Check out Avere systems. They have a clustered NFS appliance that you can spin up in EC2, which translates back-end S3 object storage into NFS for your clients. It supports between 3 and 50 nodes, and uses local RAM and SSD cache to accelerate performance. Avere has also been in the NAS acceleration/caching business since 2008, so their product is very mature.

[ Parent | on HN ]

Re:BeeGFS, the Parallel Cluster File System by sharktour on Thursday February 25, 2016 @08:17AM (#11174147)

Thanks for the heads up on Avere. Use case for us was for file parsing as part of a batch data pipeline. The latency we saw on alternatives was killer compared to directly mounted EBS. That would be my fear with an S3 option as well, especially when it presents like NFS.

[ Parent | on HN ]

Re:BeeGFS, the Parallel Cluster File System by jjawssd on Wednesday February 24, 2016 @10:22AM (#11167358)

At this time you will need to use an EC2 instance serving NFS over a big EBS volume.

[ Parent | on HN ]