News for hackers. Stuff that matters.

A comment on AWS switch from gzip to zstd – about 30% reduction in compressed S3 storage. Parent comment

Re:AWS switch from gzip to zstd – about 30% reduction in com... by silvestrov on Saturday August 20, 2022 @07:48AM (#32531285)
There is also the cost of a bug. Imagine that AWS corrupted customers data due to a compression bug in your home-grown compression code.

It is almost like encryption in this regard.

[ Parent | on HN ]
Re:AWS switch from gzip to zstd – about 30% reduction in com... by londons_explore on Sunday August 21, 2022 @04:25AM (#32538340)
Luckily by adding a checksum of pre-compression data it's very easy to catch bugs before they do widespread silent damage.
[ Parent | on HN ]