News for hackers. Stuff that matters.
Re:How multi-disk failures happen by insaneirish on Monday December 31, 2012 @12:09PM (#4989894)
I'm going to be blunt for a moment. If you are not using ZFS, you deserve what you get.

As the author realizes, hardware RAID, or naive software RAID, is becoming more and more useless given the size of volumes and the bit densities (and thus error rates) of those drives.

The only solution to this is a proper file system and volume manager that can proactively discover bit rot and give you time to do something about it. At the moment, the only real solution is ZFS.

Re:How multi-disk failures happen by 3amOpsGuy on Monday December 31, 2012 @02:38PM (#4990548)
ZFS is great, possibly the closest to perfection available at any price today.

But theres a word beginning with "O" and ending with "racle", they are so focused on the short term buck they are massacring their potential revenues with their short sighted approach of keeping Solaris out of everyone's hands.

Re:How multi-disk failures happen by cperciva on Monday December 31, 2012 @11:57PM (#4991907)
... which is why you should be using FreeBSD.
Re:How multi-disk failures happen by wglb on Wednesday January 02, 2013 @09:11PM (#5000700)
For several reasons (now including coughunitycough), I wish I had built my in-basement cluster with freebsd rather than ubuntu. Likely I will move the boxes over one-by-one.
Re:How multi-disk failures happen by ak217 on Monday December 31, 2012 @01:11PM (#4990149)
The Linux answer to ZFS is btrfs, and it's almost ready to go.
Re:How multi-disk failures happen by dredmorbius on Monday December 31, 2012 @06:45PM (#4991362)
What's it waiting on, and who other than Val is working on it?

Answering my own question: http://git.kernel.org/?p=linux/kernel/git/mason/btrfs-progs....

... and Valerie Auror's less active on that than I'd thought. Hrm.

Re:How multi-disk failures happen by Dylan16807 on Monday December 31, 2012 @02:32PM (#4990522)
Call me when btrfs has parity.
Re:How multi-disk failures happen by mprovost on Monday December 31, 2012 @05:05PM (#4991085)
That's only true for open source implementations (if you can call ZFS that, the only really decent implementation is still locked up inside Oracle). Netapp's WAFL (which ZFS copied) is the original implementation of a RAID system that is resilient to bit rot and the other array vendors (EMC, HDS etc) all have similar systems.
Re:How multi-disk failures happen by SageRaven on Monday December 31, 2012 @06:10PM (#4991282)
What features are open source ZFS implementations (ZFS v28) lacking to that on Solaris aside from encryption? I run a 6-drive raidz2 array on my FreeBSD workstation, and I put it through its paces, and it's pretty awesome. Rock solid stable, in my experience.

I hear TRIM support for ZFS is now in the HEAD branch and in the works for FreeBSD 10.

Re:How multi-disk failures happen by scarmig on Monday December 31, 2012 @12:36PM (#4990004)
ZFS is beautiful and wonderful, but my perhaps outdated understanding is that the Linux port isn't as stable or mature as it is elsewhere. Is that not true? Or is it that the advantages of ZFS are so great that people should switch to illumos or some BSD?
Re:How multi-disk failures happen by oomkiller on Monday December 31, 2012 @01:07PM (#4990132)
I haven't used the Linux version in a while, but as it's not a first class citizen of the kernel, I don't think it will ever be the same as a BSD implementation. In my opinion, if you're doing anything with storage, you'd be crazy not to use ZFS, even if that means learning a new OS/kernel.
Re:How multi-disk failures happen by lloeki on Monday December 31, 2012 @12:51PM (#4990072)
> the Linux port isn't as stable or mature as it is elsewhere.

Which one: the FUSE one, or the native ZFS on Linux under CDDL?

Re:How multi-disk failures happen by Dylan16807 on Monday December 31, 2012 @02:33PM (#4990527)
I haven't used the FUSE one extensively but the native one kept leaking memory until the system was exhausted. (Specifically it did this whenever I messed with a large number of files, I'm sure it works fine for media storage as StavrosK says.)
Re:How multi-disk failures happen by StavrosK on Monday December 31, 2012 @02:13PM (#4990432)
I'm using zfsonlinux on Ubuntu, and so far (months) it has been solid. Granted, it's just for media storage, but it's fine.
Re:How multi-disk failures happen by StavrosK on Monday December 31, 2012 @02:14PM (#4990436)
How does ZFS discover bit rot if you don't read the bits? I have mine scrubbing once a week, is that unnecessary?
Re:How multi-disk failures happen by rryan on Monday December 31, 2012 @03:54PM (#4990852)
ZFS auto-heals on read so the files you touch regularly are fine. You do need to scrub regularly to prevent bit-rot across all your files. I go with once-a-week as well.
Re:How multi-disk failures happen by andrewcooke on Monday December 31, 2012 @05:16PM (#4991124)
so how is that better than raid? it sounds identical to what is described in the article - the problem was not scrubbing (afaict).
Re:How multi-disk failures happen by ars on Tuesday January 01, 2013 @01:51AM (#4992044)
ZFS is at the file level, not the disk level. So recovering from errors (i.e. rebuilds) is MUCH faster.
Re:How multi-disk failures happen by wazoox on Tuesday January 01, 2013 @06:56AM (#4992451)
Only when the array is mostly empty. For several years hardware RAID controllers have been rebuilding only used space, too. Really, ZFS isn't that much of the miracle some want it to be.
Re:How multi-disk failures happen by olgeni on Tuesday January 01, 2013 @07:38AM (#4992501)
How do they know what space is used or unused?
Re:How multi-disk failures happen by wazoox on Tuesday January 01, 2013 @10:05AM (#4992689)
Apparently they keep a block list somewhere.
Re:How multi-disk failures happen by andrewcooke on Tuesday January 01, 2013 @08:32AM (#4992554)
but that's not what we were talking about! no-one was saying "zfs sucks as much as raid but at least it rebuilds faster afterwards". the implication was that zfs avoided the problem in the article (when, it seems, both zfs and raid need to be scrubbed, and both avoid the problem when that is done).