News for hackers. Stuff that matters.

A comment on Meta quickly detects silent data corruptions at scale. Parent comment

Re:Meta quickly detects silent data corruptions at scale by booi on Monday April 04, 2022 @11:50AM (#30908070)
ZFS and other checksumming file systems can detect bit rot in data at rest. When data is read back, that sector is checksummed and compared against when it was written before returning the request.

You can periodically scrub the entire pool to find and even fix these issues (in a pool with redundancy)

[ Parent | on HN ]
Re:Meta quickly detects silent data corruptions at scale by legulere on Monday April 04, 2022 @03:51PM (#30911231)
The bit rot could have still happened during writing though, if the bitrot is found in the first scan.
[ Parent | on HN ]
Re:Meta quickly detects silent data corruptions at scale by huhtenberg on Monday April 04, 2022 @12:46PM (#30908815)
Sure. However the main purpose of scrubbing is to flush out deteriorating media and to prompt the drive to relocate salvageable sectors and to report completely dead ones.
[ Parent | on HN ]