News for hackers. Stuff that matters.
Re:Magic Pocket: Dropbox’s Exabyte-Scale Blob Storage System by bityard on Wednesday May 17, 2023 @04:42PM (#35981028)
Sounds interesting, but I can't find the github link...
Re:Magic Pocket: Dropbox’s Exabyte-Scale Blob Storage System by james_cowling on Wednesday May 17, 2023 @08:24PM (#35982840)
We had a lot of requests for open sourcing MP but I don't think it would have been very useful. The code itself is interesting to look at but the system is designed for very large data sets, has a lot of moving parts to manage and configure, and would be very difficult to operate at anything below at least double-digit petabytes.

MP was designed for multiple exabytes across many data centers and geographic regions. A different system design (or just using S3) would be more appropriate for use at smaller scales.

Re:Magic Pocket: Dropbox’s Exabyte-Scale Blob Storage System by LeFantome on Thursday May 18, 2023 @01:08AM (#35984310)
Where I work, we deal with double to perhaps eventually triple digit petabytes. I was looking for the GitHub link. :(