News for hackers. Stuff that matters.
Re:Why RAID 5 stops working in 2009 (2007) by ars on Sunday June 01, 2014 @04:57PM (#7830645)
Clearly math isn't your strong suit.

An order of magnitude change is nothing minor. It would take the 32% chance and make it a 3.2% chance.

Maybe you don't know that ^ means to the power off?

Re:Why RAID 5 stops working in 2009 (2007) by tedsanders on Sunday June 01, 2014 @06:05PM (#7830857)
Hey, please remember to be kind to everyone. Even if you disagree with someone, insulting them adds no value for them and adds no value for the other readers on HackerNews. Insults are the rare type of comment that add value for only a single user. Even if someone is wrong, remember: we're all human. :)
Re:Why RAID 5 stops working in 2009 (2007) by ars on Sunday June 01, 2014 @06:59PM (#7831010)
I know, you're right. I was just a bit annoyed at his tone so I reacted instead of just replied.

I tried to soften it a bit by adding if perhaps he just didn't recognize the notation, but I guess it wasn't enough.

Re:Why RAID 5 stops working in 2009 (2007) by logicallee on Sunday June 01, 2014 @07:12PM (#7831049)
I did recognize it, ars. I think it's hilarious that if 100000000000000 (1e14) isn't enough reliability then 1000000000000000 (1e15) should do it.

As mentioned if you look at, for example, the change from normal bit flips (from cosmic rays) on normal RAM, versus that on ECC RAM, you would see many orders of magnitude. Given that we're speaking about errors (which have a huge standard deviatoin anyway) it is quite normal to see orders of magnitude difference. A factor of 10x is just not that big of a wish, if the error levels are causing you problems!

I also don't think that multiplying by the size of the drive is relevant to anything. It doesn't increase the chance you have an error in a specific application, etc.

What can you fill 4 TB with, that you wouldn't use software error correction on, but for which a single bit flip is unacceptable?

I can think of things like movies, raw sensor data, and other media. I don't see how multiplying by the size of the drive gives you an interesting result. You've just fallen for marketing :)

Re:Why RAID 5 stops working in 2009 (2007) by ars on Sunday June 01, 2014 @07:30PM (#7831111)
> should do it.

They actually sell 10^15 disks, so there is no excuse for 10^14 ones to exist anymore. They aren't even using more error correction to get it - they are binning drives and the better ones get sold for more.

This would be fine is the lower spec'd ones were still reasonable, but for a 4TB drive 10^14 is NOT OK, and they should not be selling them anymore.

Re:Why RAID 5 stops working in 2009 (2007) by logicallee on Sunday June 01, 2014 @07:50PM (#7831170)
I just disagree with you and think that your perspective on the matter and use of the numbers is funny. Again you repeat "For a 4TB drive 10^14 is NOT OK"... but 10^15 is. Well, if you say so.

Note: you shouldn't downvote just because you disagree with someone's perspective. I'm not going to delete these comments because I stand by them. If 1 bit flip every 4 TB is a problem for you, then don't move to 1 bit flip every 40 TB - get some kind of ECC etc.

Re:Why RAID 5 stops working in 2009 (2007) by wtallis on Sunday June 01, 2014 @08:01PM (#7831204)
He's not saying that 10^15 is good enough for all purposes. He's saying that it's closer to good enough without significantly increasing the cost. This should not be that hard for you to grasp.
Re:Why RAID 5 stops working in 2009 (2007) by logicallee on Sunday June 01, 2014 @08:08PM (#7831222)
Your tone with me is completely unwarranted, wtallis. This is what he wrote:

"

Note: This article is from 2007 and is quite prescient.

It's completely shameful how bad the specified read error rates are now.

It's to the point that if you read an entire disk 4TB you have a 32% chance of one bit being wrong!

That means hard disks can no longer be considered reliable devices that return the data written to them, you now need a second layer in software checking checksums.

http://www.wolframalpha.com/input/?i=4TB+%2F+10^14+bit++in+%...

For extra money they sell hard disks with 10^15 reliability instead of 10^14 - this should be standard!

"

Even after his (and your) clarification, it makes me chuckle to read that :) He started, "It's completely shaemful how bad the specified read error rates are now" and then ended "For extra money they sell hard disks with 10^15 reliability instead of 10^14 - this should be standard!"

This is hilarious. I guess some people here have no sense of humor though.

Error rates are not nearly as exact as that - more like marketing figures.

Re:Why RAID 5 stops working in 2009 (2007) by lindenr on Sunday June 01, 2014 @05:21PM (#7830726)
Does this mean that a 10^13 reliability has 320% chance of failure?

EDIT: in any case the correct calculation should be http://www.wolframalpha.com/input/?i=%281-%2810^-14%29%29^%2... which gives a 30% chance of failure, versus http://www.wolframalpha.com/input/?i=%281-%2810^-15%29%29^%2... for a 3.5% chance.

Re:Why RAID 5 stops working in 2009 (2007) by ars on Sunday June 01, 2014 @05:38PM (#7830784)
320% would mean you find 3 wrong bits each time you read the disk.

I was calculating the expected number of wrong bits per full read of the drive.

You calculated the chance of a perfect read which is similar but not the same.

Re:Why RAID 5 stops working in 2009 (2007) by lindenr on Sunday June 01, 2014 @07:22PM (#7831085)
Ah, I see. Could you edit your post to reflect this? As it stands it is very easy to misinterpret.
Re:Why RAID 5 stops working in 2009 (2007) by ars on Sunday June 01, 2014 @07:27PM (#7831100)
You can only edit for a little over an hour, and it's been three.

I thought "of one bit being wrong" said it, but I can see how you misread it. Hopefully people will read the thread and see these replies as well.

Re:Why RAID 5 stops working in 2009 (2007) by judk on Sunday June 01, 2014 @05:20PM (#7830723)
But only a few years of difference with Moore's Law... Which was the point of the article.
Re:Why RAID 5 stops working in 2009 (2007) by ars on Sunday June 01, 2014 @05:42PM (#7830794)
Re:Why RAID 5 stops working in 2009 (2007) by logicallee on Sunday June 01, 2014 @06:29PM (#7830935)
I have now spelled it out for you. "Reliability of 100000000000000 is unacceptable! I need exactly 1000000000000000 of reliability (a factor 10 differnece only)." It's hilariously specific. If your error rate is riding up against your usage so that you notice it, you wouldn't expect to just want to cut it by a small factor like that.
Re:Why RAID 5 stops working in 2009 (2007) by ars on Sunday June 01, 2014 @07:25PM (#7831095)
> It's hilariously specific.

The reason for the number is very simple: It actually exists.

Re:Why RAID 5 stops working in 2009 (2007) by logicallee on Sunday June 01, 2014 @07:51PM (#7831177)
I think it's probably just marketing. They're just engineering reliability targets, a specific batch could have far different rates.
Re:Why RAID 5 stops working in 2009 (2007) by abritishguy on Sunday June 01, 2014 @05:27PM (#7830747)
And clearly it isn't your's either.