Re:S3 is files, but not a filesystem
by catlifeonmars on Sunday March 10, 2024 @02:06PM
(#39661155)
In context of the comment I was addressing, it’s clear that filesystem means more than just a key value store. I’d argue that this is generally true in common vernacular.
Re:S3 is files, but not a filesystem
by anonymous-panda on Sunday March 10, 2024 @03:48PM
(#39662036)
This is a technical website discussing the nuances of filesystems. Common vernacular is how you choose to define it but even the Wikipedia definition says that directories and hierarchy are just one property of some filesystems. That they became the dominant model on local machines doesn’t take away from the more general definition that can describe distributed filesystems.
I'm kind of chuckling at this thread because you're working so hard to not understand.
I think the previous poster could/should have said, "It is not a hierarchical file system and has no concept of directories." where I added the word "hierarchical".
But it's also pretty obvious that was the point.
Re:S3 is files, but not a filesystem
by anonymous-panda on Monday March 11, 2024 @10:17PM
(#39675508)
I disagree with that characterization because the contrast by OP was that S3 is “just a KV store implying” it doesn’t meet the criteria for being considered a filesystem.
For example, you could implement POSIX directory semantics on top of S3. About the only POSIX filesystem API you couldn’t implement it append / overwrite (well you could but it might be prohibitively expensive).
Re:S3 is files, but not a filesystem
by senderista on Sunday March 10, 2024 @02:02PM
(#39661124)
A real hierarchy makes global constraints easier to scale, e.g. globally unique names or hierarchical access controls. These policies only need to scale to a single node rather than to the whole namespace (via some sort of global index).
Indeed there’s every reason to believe that a modern file system would perform significantly faster if the hierarchy was implemented as a prefix filter than actually maintaining the hierarchical data structures (at least for most operations). You can guess that this might be the case that file creation is extremely slow on modern file systems (on the order of hundreds or maybe thousands per second on a modern NVME disk that can otherwise do millions of IOPs and listing the contents of an extremely large directory is exceedingly slow)