News for hackers. Stuff that matters.
Re:ZFS 128 bit storage: Are you high? (2004) by Johnny555 on Monday February 12, 2018 @09:36PM (#16364318)
Backblaze says they are using 400 PB of storage[1], or around 2^59 bytes. Of course, it's not one big filesystem. They aren't quite doubling annually, but looks like they are growing around ~1.5X each year, so in another decade, they could be close to the 2^64 limit.

[1] https://www.backblaze.com/company/about.html

Re:ZFS 128 bit storage: Are you high? (2004) by sliken on Monday February 12, 2018 @10:54PM (#16364615)
Right, but their building block is 48 disks x whatever is best profitable (a mix of 4,6,8,10, and 12TB currently or similar). So each system is 500TB or less, zfs is a filesystem for a single node not a distributed filesystem.

Even if we ignore that factor of 800 or so (400PB spread across 500 nodes), they still would need another factor of 128,000 before they would need ZFS's 65th bit.

Keep in mind it's 2^128 blocks, not 2^128 bytes.

Backblaze would need to consume the entire planets supply of disks for a very long time AND put all those disks connected to a single linux, freebsd, or solaris box. Only then would they need the 65th bit that ZFS has for addressing blocks.

Re:ZFS 128 bit storage: Are you high? (2004) by ryacko on Tuesday February 13, 2018 @03:29AM (#16365592)
Not really. Global hard drive production is more than 2^64 bytes or 18 exabytes (SI).

https://www.anandtech.com/show/10098/market-views-2015-hard-...

Re:ZFS 128 bit storage: Are you high? (2004) by tempay on Tuesday February 13, 2018 @03:43AM (#16365657)
From that it looks like production is 130 exabytes for Seagate and Western Digital combined. Using the default block size on ZFS the limit is 128 * 1024 * 2^64 = 2 zettabytes. Even allowing for other manufacturers it's an order of magnitude more than global annual production.