News for hackers. Stuff that matters.
Re:"Amazon EBS sucks. I just lost all my data" by kiujhygfghjk on Monday May 10, 2010 @10:44AM (#1334545)
Lots of people who didn't fail statistics assume that events are independant. A bit like, the chance of my machine catching fire are 1 in a 1000, my machine did catch fire and I lost both drives - the odds on that happening must be 1 in a million!
Re:"Amazon EBS sucks. I just lost all my data" by Tamerlin on Monday May 10, 2010 @06:39PM (#1336163)
What's more relevant is that the odds of either drive failing are identical. The likelihood that the first drive will fail doesn't change because the second one failed -- which is the classic statistical blunder. ("I got 42 heads in a row, the next one's BOUND to be tails!")

Every single drive in the datacenter typically has the same likelihood of failure (since they're usually the same make and model, and similar production runs), so the odds that a drive somewhere in a large data center is failing RIGHT NOW are in reality rather high.

The Big Mac ended up being a good example of this. The likelihood of having a memory error on a normal PC is low, because the likelihood of a single DIMM having a memory error is low.

Punch that up to the 22,000 or thereabouts DIMMs that populated the Big Mac cluster, and now you're looking at a very HIGH likelihood that a large-scale computation using the cluster will experience memory errors, and therefore produce invalid results -- which is why UVa ended up replacing the entire cluster with ECC-equipped machines in short order. Until they did that, researchers had to run simulations multiple times and compare results to make sure that their simulations weren't contaminated by memory errors.

Re:"Amazon EBS sucks. I just lost all my data" by kiujhygfghjk on Tuesday May 11, 2010 @09:32AM (#1337738)
>The likelihood that the first drive will fail doesn't change because the second one failed

No thats the point, hardware failures on the same machine/rack/psu/site are not independant. A power supply spike that kills drive 0 in a RAID will probably kill the mirror drive 1 as well - that's why RAID isn't a bckup stratergy

Re:"Amazon EBS sucks. I just lost all my data" by Tamerlin on Tuesday May 11, 2010 @12:43PM (#1338448)
You missed the point -- a power supply spike isn't a hard drive failure, even if it kills a couple of drives, it's a power supply failure.

I was explaining a common misconception about statistics, and using hard drives and DIMMs as examples.

Re:"Amazon EBS sucks. I just lost all my data" by mynameishere on Monday May 10, 2010 @10:59AM (#1334599)
If amazon is advertising that single failures can't cause data losses, then a single exploding power supply (for instance) breaks that agreement.
Re:"Amazon EBS sucks. I just lost all my data" by azim on Monday May 10, 2010 @12:12PM (#1334848)
If by "exploding" power supply you mean the potential for a power supply to explode with eruptive force and destroy other equipment in the rack, I believe that the other equipment being destroyed would be considered an multiple failure. It's very unlikely that a power supply could do that (although I guess anything is possible). A proper datacenter built with Datacenter-grade equipment will have multiple redundant power supplies in a blade enclosure, fed by different rails, which come off of different main lines in to the building. So a single failed source of power won't cause a failure.