News for hackers. Stuff that matters.
Re:S3 Express Is All You Need by candiddevmike on Tuesday November 28, 2023 @03:30PM (#38450844)
EFS is really expensive and has terrible latency with small files in my experience
Re:S3 Express Is All You Need by dekhn on Tuesday November 28, 2023 @04:58PM (#38451919)
When you set up EFS did you maximize the IO settings?

Before doing that it was unacceptably slow. After doing that it was unacceptably expensive.

Re:S3 Express Is All You Need by huntaub on Tuesday November 28, 2023 @03:40PM (#38450984)
Note that EFS One Zone is priced the same as S3 Express One Zone with similar latency. One isn't better or worse than the other, it only depends on what kind of access your application needs.
Re:S3 Express Is All You Need by brazzledazzle on Tuesday November 28, 2023 @03:33PM (#38450878)
Yeah the main reason is that it's incredibly expensive. You can improve performance by allocating ahead of time but NFS has never been at its best when working with a bunch of tiny files.
Re:S3 Express Is All You Need by richieartoul on Tuesday November 28, 2023 @03:35PM (#38450913)
Do you have any more details you can share about the performance of EFS? I've never met anyone who has actually used it in anger.
Re:S3 Express Is All You Need by gchamonlive on Tuesday November 28, 2023 @03:42PM (#38451002)
Throughput scales with the amount of data in it, it is in the docs. So depending on the application, even if latency is better, the speeds are atrocious at lower volumes of persisted data.
Re:S3 Express Is All You Need by saddlerustle on Tuesday November 28, 2023 @04:52PM (#38451813)
That’s not true anymore with EFS Elastic Throughput
Re:S3 Express Is All You Need by a2tech on Tuesday November 28, 2023 @05:23PM (#38452244)
Yes, I built a moderately large system on it that used lots of small shared files. The performance was fairly terrible. There's weird little niggles with it--we had random slowdowns, throughput issues, and things just didn't work quite right.

It was an ok solution for what we were doing, but several times I came really close to just dumping it and standing up an NFS server using EBS volumes.

I also used it a couple of times to store webroots and that was a complete disaster with systems that had lots of small files (Drupal I'm looking at you).