News for hackers. Stuff that matters.
Re:ZFS 128 bit storage: Are you high? (2004) by madaxe_again on Monday February 12, 2018 @06:37PM (#16363415)
CERN are at >100PB, which is only about 6.6 doublings, which is about right with a doubling every two, not one, years. http://iopscience.iop.org/article/10.1088/1742-6596/664/4/04...
Re:ZFS 128 bit storage: Are you high? (2004) by sliken on Monday February 12, 2018 @10:56PM (#16364624)
Right, but does CERN connect all 100PB to a single machine?
Re:ZFS 128 bit storage: Are you high? (2004) by tempay on Tuesday February 13, 2018 @03:58AM (#16365710)
No. Data is mostly accessed using XRootD[1] which can be used to data from an (almost) unlimited number of nodes. So far as I know, it's optimised for large files so the number of available inodes is limited by RAM.

There is also EOS[2] which is based on XRootD and is planned to replace AFS[3] as a general purpose networked filesystem.

[1] http://xrootd.org/ [2] http://eos.web.cern.ch/ [3] http://information-technology.web.cern.ch/services/afs-servi...

Re:ZFS 128 bit storage: Are you high? (2004) by AstralStorm on Tuesday February 13, 2018 @02:54AM (#16365459)
To a cluster fs which ZFS is not. (And not all of it.)