That is extremely cool. Please tell the author(s) of that system that a stranger on the internet has appreciation for that feat!
Re:Dropbox’s Exodus from the Amazon Cloud
by willglynn on Monday March 14, 2016 @08:47PM
(#11286712)
You might be interested in a paper Microsoft published a few years ago, entitled "Erasure Coding in Windows Azure Storage", which describes some similar concepts in greater detail:
http://msr-waypoint.com/en-us/um/people/yekhanin/Papers/Usen...
The data placement isn't RAID. We encode aggregated extents of data in "volumes" that are placed on a random set of storage nodes (with sufficient physical diversity and various other constraints). Each storage node might hold a few thousand volumes, but the placement for each volume is independent of the others on the disk. If one disk fails we can thus reconstruct those volumes from hundreds of other disks simultaneously, unlike in RAID where you'd be limited in IOPS and network bandwidth to a fixed set of disks in the RAID array.
That probably sounded confusing but it's a good topic for a blog post once we get around to it.