Re:Storage Pod 6.0: Building a 60 Drive 480TB Storage Server
by mappu on Monday April 25, 2016 @04:52PM
(#11567259)
Backblaze use an in-house Java pseudo-RAID layer based on Reed-Solomon codes, with 17 data shards and 3 parity shards. There are some performance numbers here https://www.backblaze.com/blog/reed-solomon/ (2015).
Re:Storage Pod 6.0: Building a 60 Drive 480TB Storage Server
by nwmcsween on Monday April 25, 2016 @09:05PM
(#11568680)
I wouldn't mind understanding why, I'm assuming at the time ceph wasn't mature enough (and still somewhat is due to btrfs, yes I know it's optional).
Re:Storage Pod 6.0: Building a 60 Drive 480TB Storage Server
by scurvy on Tuesday April 26, 2016 @12:29AM
(#11569448)
btrfs isn't a requirement nor really a recommendation for production ceph clusters. It was really only there for weirdo benchers.
Bluestore and rocks DB really changes the back-end story altogether. No more POSIX filesystem junk with journals and such.
Wow. This is pretty shocking TBH. My basic ceph nodes will crush a 40gbps link doing a rebuild/rebalance. What's your bottleneck?