Amazon Elastic File System – Production-Ready in Three Regions

Re:Amazon Elastic File System – Production-Ready in Three Re... by jedberg on Wednesday June 29, 2016 @03:57AM (#12000135)

> What use case do you think the EFS is good for

Out of band big data/data pipeline processing. Something where you want an easy way to sync your data but can handle extended downtimes.

[ Parent | on HN ]

Re:Amazon Elastic File System – Production-Ready in Three Re... by cothomps on Wednesday June 29, 2016 @09:21AM (#12001443)

Or scenarios where you can use EFS to stage data 'for something else' (i.e. shared image / upload content that stages to a CDN, etc.)

Keep in mind (and this comes from hard experience in 'traditional' NFS web server architecture) - if you mount everything on an NFS volume, you ensure that

1) If something goes wrong on that NFS mount, everything goes wrong. (bad code deploy? All nodes are down!)

2) If you rely on an NFS mount to store everything (e.g. trust keystores for JVMs,etc.) your entire infrastructure is dependent on the I/O capabilities of that NFS mount.

3) No matter how clever you are (or how much you trust NFS clients/versions) you will deal with file locking if you are doing a fair amount of read/write from multiple nodes to a single NFS mount.

Short story - EFS will make some of the 'hard' things with distributed nodes possible, but don't make the easy things impossible to troubleshoot.

[ Parent | on HN ]