Re:X Engineering Year Retrospective
by insanitybit on Friday October 27, 2023 @09:54PM
(#38046342)
Maintaining a massive scale infra with the same availability and durability as S3 is really expensive. It's possible but hard.
[ Parent
| on HN ]
But do you need S3 durability for meme gifs that will be seen once and then just waste disk space for decades?
Re:X Engineering Year Retrospective
by johannes1234321 on Saturday October 28, 2023 @06:52AM
(#38048788)
At least temporarily old images weren't available and some people cared: https://www.forbes.com/sites/mattnovak/2023/08/19/twitter-de...
There's a difference between "all images" and "one in 100 million images"
(S3 durability is "for every ten million objects stored, you can expect to incur an average loss of a single object once every 10,000 years")
Re:X Engineering Year Retrospective
by insanitybit on Saturday October 28, 2023 @10:30AM
(#38050090)
Maybe not, but you could switch to single-zone S3 in that case and cut your costs down ~70%.
Migrating storage off of cloud is just really hard.