News for hackers. Stuff that matters.
Re:AWS switch from gzip to zstd – about 30% reduction in com... by badpun on Saturday August 20, 2022 @03:01AM (#32529878)
Certainly, if used as a data store for a data-lake-like solution, it's much more convenient to store data in uncompressed form, knowing that the underlying storage solution will take care of that for you. This way, you can just dump Json files in without it feeling like a collosal waste (or having to do extra work of converting them to a compressed format, such as Avro).
Re:AWS switch from gzip to zstd – about 30% reduction in com... by paranoidrobot on Saturday August 20, 2022 @03:25AM (#32530012)
Storage level compression usually benefits whomever owns the storage.

I doubt Amazon intends to bill on compressed size.