News for hackers. Stuff that matters.
Re:Magic Pocket: Dropbox’s Exabyte-Scale Blob Storage System by sosodev on Wednesday May 17, 2023 @01:55PM (#35978928)
It's extremely hard to get availability higher than that. Possible but not something companies are willing to promise in an SLA.
Re:Magic Pocket: Dropbox’s Exabyte-Scale Blob Storage System by awill on Wednesday May 17, 2023 @02:23PM (#35979274)
I'd say it's not so much that it's really hard, it's that the compromises aren't worth it.

note, I worked on S3 2015-2017

Re:Magic Pocket: Dropbox’s Exabyte-Scale Blob Storage System by abeppu on Wednesday May 17, 2023 @02:31PM (#35979367)
So ... e.g. for 5 nines, the erasure code configuration would demand that do more writes in more locations and the cost impact is too high?
Re:Magic Pocket: Dropbox’s Exabyte-Scale Blob Storage System by jl6 on Wednesday May 17, 2023 @04:09PM (#35980587)
I imagine that as you add more nines, you start to hit more problems that are more out of your control. Like, how many nines do your backup diesel generators have?
Re:Magic Pocket: Dropbox’s Exabyte-Scale Blob Storage System by skrtskrt on Wednesday May 17, 2023 @04:25PM (#35980816)
or replication if you're not erasure coding.

So yeah you need more storage-optimized server racks and all the associated manpower and maintenance, you also need them to be distributed across different datacenters and zones which of course also impacts latency and your ability to provide some appearance of consistency, then you also need the same distribution for stateless services serving the data.

On and on and on and you might be nearly doubling cost to get to an extra 9 that almost all of your customers won't care about.

Re:Magic Pocket: Dropbox’s Exabyte-Scale Blob Storage System by sosodev on Wednesday May 17, 2023 @03:40PM (#35980210)
That's a fair point. It would be quite possible if the customers were willing to pay a lot more.

I worked on DigitalOcean's object storage for about a year not long ago. Makes sense that those of us who have been in this space would be interested in this article haha.