Re:You can list a directory containing 8 million files But n...
by tedunangst on Monday August 15, 2011 @10:13PM
(#2889532)
The only issue I'm aware of with gzip is actually in zlib, where it stored 32-bit byte counters, but those were strictly optional and it works fine with data that overflowed them. The zlib window size may be only 32k, but bzip2 doesn't do that much better with 900k and a better algorithm, so I wouldn't consider it embarrassingly inefficient.
[ Parent
| on HN ]
Re:You can list a directory containing 8 million files But n...
by moe on Tuesday August 16, 2011 @07:20AM
(#2890711)
I was referring to the lack of SMP support in gzip (see http://www.zlib.net/pigz/).