News for hackers. Stuff that matters.
Re:S3 is files, but not a filesystem by kbolino on Sunday March 10, 2024 @11:13AM (#39659790)
> But surely you need to track that elsewhere anyway?

Why? If the S3 structure and listing is sufficient, I don't need to store anything else anywhere else.

Many use cases may involve other requirements that S3 can't meet, such as being able to find the same object via different keys, or being able to search through the metadata fields. However, if the requirements match up with S3's structure, then additional services are unnecessary and keeping them in sync with S3 is more hassle than it's worth.

Re:S3 is files, but not a filesystem by tjoff on Sunday March 10, 2024 @11:36AM (#39660008)
I agree, but something as simple (in functionality) as that ought to be an edge-case. Not a defining feature of S3.
Re:S3 is files, but not a filesystem by orf on Sunday March 10, 2024 @12:01PM (#39660197)
It’s fundamental to how S3 works and its ability to scale, so it is a defining feature of S3.

If you think wider, a bucket itself is just a prefix.

Re:S3 is files, but not a filesystem by tjoff on Sunday March 10, 2024 @05:00PM (#39662486)
From amazons perspective, sure!

But that's not what we are discussing.

Re:S3 is files, but not a filesystem by dekhn on Sunday March 10, 2024 @11:56AM (#39660152)
it's a property of the system that I, as an architect, would seriously consider as part of my system's design. I've worked with many systems where iterating over items in order starting from a prefix is extremely cheap (sstables).