News for hackers. Stuff that matters.
Re:Amazon S3 Object Lambda by cyberdummy on Saturday March 20, 2021 @05:56AM (#26521921)
My use case would be to transform log files from something like TSV to JSON, but without being able to stream the output seems like the file size is going to be limited to the lambda memory size or the /tmp 512MB.
Re:Amazon S3 Object Lambda by orf on Saturday March 20, 2021 @07:24AM (#26522322)
But you can stream the input and the output?
Re:Amazon S3 Object Lambda by cyberdummy on Saturday March 20, 2021 @07:26AM (#26522341)
Thanks missed that bit:

For larger objects, the WriteGetObjectResponse API supports chunked transfer encoding to implement a streaming data transfer.