News for hackers. Stuff that matters.
Re:ZFS 128 bit storage: Are you high? (2004) by vesinisa on Monday February 12, 2018 @07:21PM (#16363680)
Indeed. "Cloud" is essentially tons of commodity hardware nodes running a tailored userspace distributed file system application. There now certainly exist cloud services that host well in excess of 2^64 bytes, but they are not hosted on traditional file systems, but an array of those.

I can't certainly blame their choice though, and 16-million terabyte hard drive arrays (the limit of 64-bit addressing) on a large mainframe are really just a few quantum leaps away. Heck, I still vividly recall buying a MASSIVE 40 GB HDD in 2000 - it seemed excessive beyond wildest dreams at the time (and was promptly filled to brim at a LAN party.)

Since, advances in mass storage tech, most importantly the successful commercialization of perpendicular recording in 2005, mean that nowadays 12 TB drives are commercially viable - roughly 1000x the size of a 40 GB drive.

In the next 20 years, petabyte-sized drives might well be available (though almost certainly not based on any form of magnetic recording). Once you hook hundred 50-petabyte drives to a single fileserver, you start closing in on limitations of 64-bit addressing.

Re:ZFS 128 bit storage: Are you high? (2004) by dsr_ on Monday February 12, 2018 @08:46PM (#16364100)
Overly pedantic quibble: a quantum of anything is the minimum possible unit. One planck length, time, mass, charge, temperature.

Everybody uses it to mean "big". Oh, language.

Re:ZFS 128 bit storage: Are you high? (2004) by taneq on Monday February 12, 2018 @09:44PM (#16364348)
"Quantum leap" is typically interpreted as "big leap" but I believe the true implication is more like "indivisible leap", in line with your quibble. A Turing-complete computer is a "quantum leap" ahead of a non-Turing-complete calculator. A warp drive is a "quantum leap" ahead of a reaction drive. You either have all of it or none of it.
Re:ZFS 128 bit storage: Are you high? (2004) by rusk on Tuesday February 13, 2018 @04:47AM (#16365932)
Quantum leap is an increase in the units, or “quanta” you use to measure something i.e. MHz to GHz - the term doesn’t relate directly to quantum mechanics
Re:ZFS 128 bit storage: Are you high? (2004) by dsr_ on Tuesday February 13, 2018 @06:01AM (#16366211)
In your example you are using the same units - Hertz, one cycle per second - and adding SI prefixes for million X and billion X.
Re:ZFS 128 bit storage: Are you high? (2004) by rusk on Tuesday February 13, 2018 @07:00AM (#16366462)
Yes, but the "quantum" has increased by order of magnitude.

The point is, that the increase in frequency is so large, that using MHz is no longer sensible.

There has been a "quantum leap" in frequency.

Re:ZFS 128 bit storage: Are you high? (2004) by quickthrower2 on Monday February 12, 2018 @11:14PM (#16364696)
I know who we should ask: Ziggy
Re:ZFS 128 bit storage: Are you high? (2004) by beobab on Tuesday February 13, 2018 @03:41AM (#16365645)
I loved that show so much! It was ages after Enterprise came out that I stopped expecting Captain Archer to say "Oh boy!" just before the main title.
Re:ZFS 128 bit storage: Are you high? (2004) by dmix on Monday February 12, 2018 @09:37PM (#16364320)
But is a "Quantum leap" really equivalent to leaping one planck? Honest question.

I assumed it implied something far 'larger' such as a leap through spacetime...

Re:ZFS 128 bit storage: Are you high? (2004) by white-flame on Monday February 12, 2018 @11:41PM (#16364816)
A quantum leap is a discontinuity, a change that cannot happen gradually.

It typically implies a revolutionary change over evolutionary improvement.

Re:ZFS 128 bit storage: Are you high? (2004) by aidenn0 on Monday February 12, 2018 @09:50PM (#16364365)
I believe the term originally applied to electron energy level transitions within an atom, which only vaguely correlates with anything one might call distance.

The interesting thing there was that the electrons existed only at discrete energy levels, and the transition between them appeared instantaneous.

Re:ZFS 128 bit storage: Are you high? (2004) by ianai on Monday February 12, 2018 @11:15PM (#16364702)
I always assumed that sprang from the tv show with that name.
Re:ZFS 128 bit storage: Are you high? (2004) by vesinisa on Tuesday February 13, 2018 @03:49AM (#16365674)
In this case, I actually used it purposefully. Hitting on quantum mechanical limits are in part holding us from infinitely increasing the information density on HDDs and SSDs.
Re:ZFS 128 bit storage: Are you high? (2004) by versteegen on Tuesday February 13, 2018 @09:43PM (#16372990)
The usage in the article is that 64/128 bits is the addressing used for the blocks. A block is 512 bytes. So a 64-bit filesystem would actually be limited to 2^73 bytes = 8192 EiB = 8.6 billion TiB of storage.

No cloud vendor has a billion harddisks, that's for sure.

(The filesystem might only support a maximum file size of 2^64 bytes, but that's nothing to do with the capacity of the storage array)

Re:ZFS 128 bit storage: Are you high? (2004) by wyoung2 on Monday February 19, 2018 @10:58AM (#16413608)
The article isn't talking about the size of raw disk blocks, better called the sector size. It's talking about ZFS blocks, which are variable in size, defaulting to 128 kB: https://en.wikipedia.org/wiki/ZFS#Variable_block_sizes

ZFS aside, the 512 byte sector isn't even a hard limit at the storage medium level. Disks with 528 byte sectors — and other odd sizes — have been available in the enterprise world for a long time now: https://en.wikipedia.org/wiki/Hard_disk_drive#Market_segment...

HDDs and SSDs with 4 kB sectors dominate the consumer market now: https://en.wikipedia.org/wiki/Advanced_Format

Re:ZFS 128 bit storage: Are you high? (2004) by killjoywashere on Monday February 12, 2018 @08:16PM (#16363970)
Isn't there an XKCD about the limit of flash storage being 3 PB per gallon?
Re:ZFS 128 bit storage: Are you high? (2004) by mewse on Monday February 12, 2018 @08:43PM (#16364090)
I think you may be referring to an image from this What-If article, where the capacity of a gallon of MicroSD cards is estimated at 1.6PB per gallon:

https://what-if.xkcd.com/31/

Re:ZFS 128 bit storage: Are you high? (2004) by dimensi0nal on Monday February 12, 2018 @09:03PM (#16364185)
It's 12.8PB per gallon now.
Re:ZFS 128 bit storage: Are you high? (2004) by perl4ever on Monday February 12, 2018 @10:44PM (#16364575)
A gallon of flash cards is great, but you do have to figure out which one you want after they are delivered. I'm wondering whether there is such a thing as an automated flash card library. I know people have archives of tapes like that.
Re:ZFS 128 bit storage: Are you high? (2004) by Dylan16807 on Monday February 12, 2018 @11:37PM (#16364804)
The thing about flash is that it's cheap and easy to keep it all permanently online. You can get a stack of 2.5 inch SSDs for the same price as microsd cards, and plugging them into a bus takes less space than a tape robot.

When you're looking at the same price for two systems, and one is 100x-1000x faster at the cost of being 'merely' hundreds of TB per gallon instead of a few PB per gallon, nobody is going to bother engineering the latter just to save a few bucks on shipping.

Re:ZFS 128 bit storage: Are you high? (2004) by detaro on Tuesday February 13, 2018 @09:29AM (#16367330)
Tape is a lot better at keeping data while in storage though.