News for hackers. Stuff that matters.
Re:Show HN: Low-cost backup to S3 Glacier Deep Archive by kbumsik on Friday September 16, 2022 @08:46AM (#32865383)
What is the maximum size of each .tar.zstd.ssl ?

We have a storage with 40TB with 100 million files, then what is the expected number of archive files?

Re:Show HN: Low-cost backup to S3 Glacier Deep Archive by hampereddustbin on Friday September 16, 2022 @08:49AM (#32865401)
S3 max filesize is 5TB, so with that you'd have to have atleast 8 archive files. You can use byteranges to fetch only a single file out of it if you have the means to determine that range.
Re:Show HN: Low-cost backup to S3 Glacier Deep Archive by mrich on Friday September 16, 2022 @09:27AM (#32865784)
Hmm, conflicting info?

https://aws.amazon.com/s3/faqs/

> Individual Amazon S3 objects can range in size from a minimum of 0 bytes to a maximum of 5 TB.

https://docs.aws.amazon.com/amazonglacier/latest/dev/uploadi...

> Using the multipart upload API, you can upload large archives, up to about 40,000 GB (10,000 * 4 GB).

Since the archive must be restored to S3 before download, I wonder what will happen if you upload and restore a 5 TB + 1 byte archive?