News for hackers. Stuff that matters.
Re:S3 is files, but not a filesystem by Spivak on Sunday March 10, 2024 @01:43PM (#39660968)
If I wanted to use S3 as a filesystem in the manner people are describing I would probably start looking at storing filesystem metadata in a sidecar database so you can get directory listings, permissions bits, xattrs and only have to round-trip to S3 when you need the content.
Re:S3 is files, but not a filesystem by SOLAR_FIELDS on Sunday March 10, 2024 @02:03PM (#39661128)
Isn't this essentially what systems like Minio and SeaweedFS do with their S3 integrations/mirroring/caching? What you describe sounds a lot like SeaweedFS Filer when backed by S3