News for hackers. Stuff that matters.
Re:Building a 30 PB storage cluster in the heart of SF by bayindirh on Wednesday October 01, 2025 @11:29AM (#45438905)
The disk failure rates are very low when compared to decade ago. I used to change more than a dozen disks every week a decade ago. Now it's an eyebrow raising event which I seldom see.

I think following Backblaze's hard disk stats is enough at this point.

Re:Building a 30 PB storage cluster in the heart of SF by gordonhart on Wednesday October 01, 2025 @12:13PM (#45439489)
Backblaze reports an annual failure rate of 1.36% [0]. Since their cluster uses 2,400 drives, they would likely see ~32 failures a year (extra ~$4,000 annual capex, almost negligible).

[0] https://www.backblaze.com/cloud-storage/resources/hard-drive...

Re:Building a 30 PB storage cluster in the heart of SF by joering2 on Wednesday October 01, 2025 @01:45PM (#45440700)
Their rate will probably be higher since they are utilizing used drives. From the spec:

2,400 drives. Mostly 12TB used enterprise drives (3/4 SATA, 1/4 SAS). The JBOD DS4246s work for either.

Re:Building a 30 PB storage cluster in the heart of SF by antisthenes on Wednesday October 01, 2025 @06:02PM (#45444074)
Not necessarily, since disk failures are typically U-shaped.

Buying used drives eliminates the high rate of early failure (but does get you a bit closer to the 2nd part of the U-curve).

Typically most drives would become more obsolete before hitting the high failure rate of the right side of the U-curve from longevity (7+ years)

Re:Building a 30 PB storage cluster in the heart of SF by toast0 on Thursday October 02, 2025 @03:28AM (#45447133)
I bet you still have a higher early failure rate because of the stress from transportation, even if there's no funny business. And I expect some funny business because used enterprise drives often come with wiped SMART data, some drives may have been retired by sophisticated clients who decided they were near failure.
Re:Building a 30 PB storage cluster in the heart of SF by dist-epoch on Thursday October 02, 2025 @05:38AM (#45447759)
Physically moving the drive tends to reset the U-shape. Some will be damaged.