Re:S3 scales to petabytes a second on top of slow HDDs
by foobarian on Wednesday September 24, 2025 @09:20AM
(#45359942)
Do you know if some of these systems have components to periodically checksum the data at rest?
[ Parent
| on HN ]
Re:S3 scales to petabytes a second on top of slow HDDs
by bayindirh on Wednesday September 24, 2025 @09:52AM
(#45360408)
ZFS/OpenZFS can do scrub and do block-level recovery. I'm not sure about Lustre, but since Petabyte sized storage is its natural habitat, there should be at least one way to handle that.