PEP 594 – Removing dead batteries from Python's standard library

Re:PEP 594 – Removing dead batteries from Python's standard ... by masklinn on Thursday May 23, 2019 @03:54AM (#19989505)

> LZMA is better than gzip i think.

LZMA provides much better compression at much higher costs. Generally speaking it's pretty strictly better than bzip2, not necessarily gzip (DEFLATE, really).

In my experience, zstd can be considered better than gzip/deflate (almost every time I tried it, it provided as-good-or-better compression at much faster throughput).

[ Parent | on HN ]

Re:PEP 594 – Removing dead batteries from Python's standard ... by maxnoe on Thursday May 23, 2019 @05:34AM (#19990037)

Yes, zstandard turned out to be the best option in all our tests on small to really large data (couple of mb to gigabytes filesize).

A few percent better compression than gzip and nearly 50 % faster decompression.

Gzip is pretty slow in the python standard lib.

The python zstandard bindings unfortunately do not allow back seeking.

[ Parent | on HN ]