News for hackers. Stuff that matters.
Re:Gcsfuse: A user-space file system for interacting with Go... by capableweb on Wednesday September 06, 2023 @07:31AM (#37403626)
> Append workloads are common in distributed systems.

Bringing back the topic to what the parent was saying; since S3 is a pretty common system, and a distributed system at that, are you saying that S3 does support appending data? AFAIK, S3 never supported any append operations.

Re:Gcsfuse: A user-space file system for interacting with Go... by ozfive on Wednesday September 06, 2023 @07:44AM (#37403716)
It does not. Consider using services like Amazon Kinesis Firehose, which can buffer and batch logs, then periodically write them to S3.
Re:Gcsfuse: A user-space file system for interacting with Go... by vlovich123 on Wednesday September 06, 2023 @12:55PM (#37407773)
I’ll add some nuance here. You can implement append yourself in a clunk way. Create a new multipart upload for the file, copy its existing contents, create a new part appending what you need, and then complete the upload.

Not as elegant / fast as GCS’s and there may be other subtleties, but it’s possible to simulate.