News for hackers. Stuff that matters.
Re:Storage Pod 6.0: Building a 60 Drive 480TB Storage Server by scurvy on Monday April 25, 2016 @03:34PM (#11566718)
> If we do a full pod swap for a blank, we are disk / CPU limited in the rebuild, not 10 Gbit/sec limited

Wow. This is pretty shocking TBH. My basic ceph nodes will crush a 40gbps link doing a rebuild/rebalance. What's your bottleneck?

Re:Storage Pod 6.0: Building a 60 Drive 480TB Storage Server by mappu on Monday April 25, 2016 @04:52PM (#11567259)
Backblaze use an in-house Java pseudo-RAID layer based on Reed-Solomon codes, with 17 data shards and 3 parity shards. There are some performance numbers here https://www.backblaze.com/blog/reed-solomon/ (2015).
Re:Storage Pod 6.0: Building a 60 Drive 480TB Storage Server by nwmcsween on Monday April 25, 2016 @09:05PM (#11568680)
I wouldn't mind understanding why, I'm assuming at the time ceph wasn't mature enough (and still somewhat is due to btrfs, yes I know it's optional).
Re:Storage Pod 6.0: Building a 60 Drive 480TB Storage Server by scurvy on Tuesday April 26, 2016 @12:29AM (#11569448)
btrfs isn't a requirement nor really a recommendation for production ceph clusters. It was really only there for weirdo benchers.

Bluestore and rocks DB really changes the back-end story altogether. No more POSIX filesystem junk with journals and such.