News for hackers. Stuff that matters.
Re:Streamz: Python pipelines to manage continuous streams of... by toolslive on Friday March 27, 2020 @05:35AM (#22701423)
you can also use the upload multipart feature of s3. Basically, you buffer until you have a sizeable chunk of the incoming stream, then upload that chunk; iterate. At the end you tell s3 to concatenate the parts.

There are no comments on this comment yet.