Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on Python – Writing large ZIP archives without memory inflation. Parent comment
https://github.com/d136o/StreamingUnzip
Basically, if you have a big zip file with many files in it (csvs for example), you can pipe out the decompressed data…
It’s a bit obtuse to use since it calls for the end chunk of a zip archive (it may come from s3 for example).
There are no comments on this comment yet.
https://github.com/d136o/StreamingUnzip
Basically, if you have a big zip file with many files in it (csvs for example), you can pipe out the decompressed data…
It’s a bit obtuse to use since it calls for the end chunk of a zip archive (it may come from s3 for example).