Re:Ext4 data corruption in 6.1 stable
by Modified3019 on Saturday December 09, 2023 @05:15PM
(#38586641)
Is this triggered under certain workloads, or has it been chewing data for everyone, and how much?
[ Parent
| on HN ]
It appears to require O_DIRECT, which is notoriously buggy and no sane program should ever use.
Could you share your source on how/when/if O_DIRECT is required? Have a link?
It's in this HN submission's link. It could be that O_SYNC is also needed.
> Is this triggered under certain workloads, or has it been chewing data for everyone, and how much?
Unless you are checksumming your files through a daemon run on a schedule (IDS style) AND manually review the results every now and then, you can't know.
If you have versioned backups, you can diff against update_day-1 without an additional tool.
I have versioned backups for a few months. Most people don't and can't (it requires a lot of storage)
Even if they have them, the diffing needs to be done.
Given the past problems with ZFS, I think I'll write a summarizer, that creates a database of metadata for each backup: it will be small to keep around, and may be use more easily to determine which backup contains the uncorrupted file.