News for hackers. Stuff that matters.
Re:S3st: Stream data from multiple S3 objects directly into ... by djhworld on Sunday October 06, 2019 @02:30PM (#21173866)
One thing to be careful of with this is the Data Transfer (egress) cost you will incur streaming data out from S3.

If you're just wanting to do a 'grep' style action on an S3 prefix, might be worth looking into "S3 Select"for your use case instead

Re:S3st: Stream data from multiple S3 objects directly into ... by loige on Sunday October 06, 2019 @05:29PM (#21175294)
Very good point, this is probably worth mentioning in the README. I'll add a note there for sure!