News for hackers. Stuff that matters.

A comment on AWS switch from gzip to zstd – about 30% reduction in compressed S3 storage.

Re:AWS switch from gzip to zstd – about 30% reduction in com... by abotsis on Saturday August 20, 2022 @03:41PM (#32534638)
But they still only support gzip or bzip2 for S3 Select’ing json files :(
[ Parent | on HN ]
Re:AWS switch from gzip to zstd – about 30% reduction in com... by klauspost on Monday August 22, 2022 @06:37AM (#32549617)
If relevant for you, we have an unadvertised feature in MinIO, that adds Zstandard, LZ4, Snappy support:

https://github.com/minio/minio/blob/master/internal/s3select...

[ Parent | on HN ]