Re:Is POSIX really outdated?
by PaulDavisThe1st on Thursday October 19, 2023 @12:47PM
(#37945251)
> By now it wouldn't be surprising if it doesn't, and handles block storage itself bypassing the kernel.
So you imagine a process somehow granted the ability to bypass the kernel and do disk i/o directly from user space. Interesting concept, but I would consider that surprising if true. Bypassing filesystems is entirely likely, but that has nothing to do with bypassing POSIX (e.g. open/read/write/close/ioctl).
Re:Is POSIX really outdated?
by yencabulator on Thursday October 19, 2023 @01:40PM
(#37945964)
[delayed]
Re:Is POSIX really outdated?
by erik_seaberg on Thursday October 19, 2023 @03:55PM
(#37947865)
Originally not, but they advertise strong read-after-write consistency as of December 2020.
https://aws.amazon.com/blogs/aws/amazon-s3-update-strong-rea...
Re:Is POSIX really outdated?
by yencabulator on Thursday October 19, 2023 @04:12PM
(#37948080)
As far as I know, you still don't get e.g. create-if-not-exist. The object listing is now strongly consistent, but you don't get to do atomic operations on it.
1. We have no idea if S3 uses POSIX to do file IO at the base. By now it wouldn't be surprising if it doesn't, and handles block storage itself bypassing the kernel. The S3 API is more restrictive and so you can probably optimize by not using kernel filesystems. Even Ceph does this now (BlueStore writes directly to flash devices bypassing existing file systems).
2. S3 API and POSIX file IO aren't that different. They certainly aren't dealing with radically different concepts. The differences are more to do with the difficulties of supporting the full featureset in a distributed and performant manner.
S3 is different because it needs/wants to be fully stateless, whereas POSIX is fundamentally stateful (the file descriptor, current directory, etc). It's willing to suffer less efficiency on each procedure call to get that statelessness. And it avoids operations that require strong consistency such as true directories, mtimes, read-after-write, then tosses some stuff that isn't important if you're just storing files like the UNIX DACL permissions.
But ultimately, they're both storing files. The differences are fairly minor.