News for hackers. Stuff that matters.
Re:X Engineering Year Retrospective by insanitybit on Friday October 27, 2023 @06:13PM (#38044678)
> Among the changes we made was a shift of all media/blob artifacts out of the cloud, which reduced our overall cloud data storage size by 60%, and separately, we succeeded in reducing cloud data processing costs by 75%.

Huh. I feel like that's the one place to not leave cloud. 90% of why I want to use AWS is S3.

Re:X Engineering Year Retrospective by smaps on Friday October 27, 2023 @06:24PM (#38044794)
Cloud storage is expensive, I’m willing to bet that’s a lot of money saved at their scale.
Re:X Engineering Year Retrospective by insanitybit on Friday October 27, 2023 @09:54PM (#38046342)
Maintaining a massive scale infra with the same availability and durability as S3 is really expensive. It's possible but hard.
Re:X Engineering Year Retrospective by kalleboo on Friday October 27, 2023 @10:34PM (#38046557)
But do you need S3 durability for meme gifs that will be seen once and then just waste disk space for decades?
Re:X Engineering Year Retrospective by johannes1234321 on Saturday October 28, 2023 @06:52AM (#38048788)
At least temporarily old images weren't available and some people cared: https://www.forbes.com/sites/mattnovak/2023/08/19/twitter-de...
Re:X Engineering Year Retrospective by kalleboo on Saturday October 28, 2023 @08:53AM (#38049418)
There's a difference between "all images" and "one in 100 million images"

(S3 durability is "for every ten million objects stored, you can expect to incur an average loss of a single object once every 10,000 years")

Re:X Engineering Year Retrospective by insanitybit on Saturday October 28, 2023 @10:30AM (#38050090)
Maybe not, but you could switch to single-zone S3 in that case and cut your costs down ~70%.

Migrating storage off of cloud is just really hard.

Re:X Engineering Year Retrospective by Freedom2 on Friday October 27, 2023 @06:22PM (#38044770)
That's why Musk is forward thinking, leading the charge for us techies to follow.
Re:X Engineering Year Retrospective by monkaiju on Friday October 27, 2023 @07:02PM (#38045104)
Lol, 'forward thinking' by moving one of the most expensive cloud costs internal in an app that clearly doesn't need that storage near their other cloud assets and operates at a scale few other services do? Woooow, he's sooooo smart. Nobody else has thought of this