News for hackers. Stuff that matters.
Re:Raid-Z Expansion Feature for ZFS Goes Live by mustache_kimono on Tuesday February 08, 2022 @07:09PM (#30266706)
They even admit this in the video -- "No one is to blame here except us" which means "Holy shit! We really messed this up."

Yes, they should have been scrubbing their pools, but I don't think this was bit rot. Millions of data errors is not what bit rot looks like. This looks exactly like bad hardware.

Re:Raid-Z Expansion Feature for ZFS Goes Live by ksec on Wednesday February 09, 2022 @05:46AM (#30271199)
ServetheHome actually reported the hard drive LTT are using had higher failure rate than others. Even from a consumer hardware perspective. And they were suppose to be enterprise drive.

It is just bad hardware, bad setup and bad everything all cramped together.

Re:Raid-Z Expansion Feature for ZFS Goes Live by mustache_kimono on Wednesday February 09, 2022 @09:44AM (#30273158)
I've never seen a HDD fail like that, but I'm willing to believe it's possible. I have seen read/write errors because of a buggy implementation of ALPM.

But, agreed, whatever it was, if they were paying attention, they could have diagnosed and remediated well before they had any data loss.