News for hackers. Stuff that matters.
Re:S3 Express Is All You Need by sparrc on Tuesday November 28, 2023 @04:05PM (#38451301)
In my experience the biggest drawback with EFS is startup time for systems that mount it in.

For example a container or EC2 instance might only need a tiny bit of your storage and with s3 can just download what it needs when it needs it.

As opposed to EFS where the container or instance needs to load in the entire datastore on startup which can add minutes to startup time if the EFS drive is large.

Re:S3 Express Is All You Need by dpedu on Tuesday November 28, 2023 @04:13PM (#38451396)
My understanding is that EFS is exposed as an NFS share. I haven't used it personally, but NFS mounting is generally fast, nearly instant. What does "load in the entire datastore" mean?
Re:S3 Express Is All You Need by ericpauley on Tuesday November 28, 2023 @04:39PM (#38451676)
EFS mounting is definitely nearly instant. I use it constantly.
Re:S3 Express Is All You Need by dekhn on Tuesday November 28, 2023 @07:36PM (#38453807)
Many servers start up, load a ton of data from storage into RAM, and then happily serve that data for a long time. The latency of the server when starting up before it can service its first request is entirely based on the throughput of the data load.

Often these servers will load 128+GB of data into RAM (crazy, huh?) and even if you have 1GB/sec it's still two minutes for the server to start up.

Re:S3 Express Is All You Need by dpedu on Wednesday November 29, 2023 @12:57PM (#38462702)
1GB/s is the same speed from EFS or S3.
Re:S3 Express Is All You Need by dekhn on Wednesday November 29, 2023 @01:22PM (#38463048)
I didn't say otherwise.