News for hackers. Stuff that matters.

A comment on AWS switch from gzip to zstd – about 30% reduction in compressed S3 storage. Parent comment

Re:AWS switch from gzip to zstd – about 30% reduction in com... by whoknew1122 on Saturday August 20, 2022 @07:26PM (#32536046)
Amazon is AWS's biggest customer, but I've never been told to compress things with zstd while working at AWS. And services still compress files as gzip before storing data in S3.

Maybe data in S3 is compressed? I don't know the internals of S3.

[ Parent | on HN ]
Re:AWS switch from gzip to zstd – about 30% reduction in com... by buchanmilne on Monday August 22, 2022 @07:58AM (#32550166)
> Amazon is AWS's biggest customer, but I've never been told to compress things with zstd while working at AWS.

You may have switched transparently to using it (e.g. for your application log files), via internal Amazon tooling (that many AWS services use).

However, this tweet wasn't about AWS customer's data, but AWS's own data.

> Maybe data in S3 is compressed? I don't know the internals of S3.

Almost every other AWS service uses S3 for storing something.

Think of EBS snapshots, DynamoDB backups, RDS backups.

And that's not even the service-internal data.

[ Parent | on HN ]