News for hackers. Stuff that matters.
Re:X Engineering Year Retrospective by smaps on Friday October 27, 2023 @06:24PM (#38044794)
Cloud storage is expensive, I’m willing to bet that’s a lot of money saved at their scale.
Re:X Engineering Year Retrospective by insanitybit on Friday October 27, 2023 @09:54PM (#38046342)
Maintaining a massive scale infra with the same availability and durability as S3 is really expensive. It's possible but hard.
Re:X Engineering Year Retrospective by kalleboo on Friday October 27, 2023 @10:34PM (#38046557)
But do you need S3 durability for meme gifs that will be seen once and then just waste disk space for decades?
Re:X Engineering Year Retrospective by johannes1234321 on Saturday October 28, 2023 @06:52AM (#38048788)
At least temporarily old images weren't available and some people cared: https://www.forbes.com/sites/mattnovak/2023/08/19/twitter-de...
Re:X Engineering Year Retrospective by kalleboo on Saturday October 28, 2023 @08:53AM (#38049418)
There's a difference between "all images" and "one in 100 million images"

(S3 durability is "for every ten million objects stored, you can expect to incur an average loss of a single object once every 10,000 years")

Re:X Engineering Year Retrospective by insanitybit on Saturday October 28, 2023 @10:30AM (#38050090)
Maybe not, but you could switch to single-zone S3 in that case and cut your costs down ~70%.

Migrating storage off of cloud is just really hard.