News for hackers. Stuff that matters.
Re:Ext4 data corruption in 6.1 stable by Modified3019 on Saturday December 09, 2023 @05:15PM (#38586641)
Is this triggered under certain workloads, or has it been chewing data for everyone, and how much?
Re:Ext4 data corruption in 6.1 stable by o11c on Saturday December 09, 2023 @06:49PM (#38587461)
It appears to require O_DIRECT, which is notoriously buggy and no sane program should ever use.
Re:Ext4 data corruption in 6.1 stable by spyc on Sunday December 10, 2023 @09:31AM (#38591727)
Could you share your source on how/when/if O_DIRECT is required? Have a link?
Re:Ext4 data corruption in 6.1 stable by fulafel on Monday December 11, 2023 @03:41AM (#38598746)
It's in this HN submission's link. It could be that O_SYNC is also needed.
Re:Ext4 data corruption in 6.1 stable by csdvrx on Saturday December 09, 2023 @05:58PM (#38587030)
> Is this triggered under certain workloads, or has it been chewing data for everyone, and how much?

Unless you are checksumming your files through a daemon run on a schedule (IDS style) AND manually review the results every now and then, you can't know.

Re:Ext4 data corruption in 6.1 stable by uselpa on Sunday December 10, 2023 @02:54AM (#38589928)
If you have versioned backups, you can diff against update_day-1 without an additional tool.
Re:Ext4 data corruption in 6.1 stable by csdvrx on Sunday December 10, 2023 @02:35PM (#38594208)
I have versioned backups for a few months. Most people don't and can't (it requires a lot of storage)

Even if they have them, the diffing needs to be done.

Given the past problems with ZFS, I think I'll write a summarizer, that creates a database of metadata for each backup: it will be small to keep around, and may be use more easily to determine which backup contains the uncorrupted file.

Re:Ext4 data corruption in 6.1 stable by uselpa on Sunday December 10, 2023 @02:48PM (#38594351)
I use borgbackup so the storage requirements are fairly low if the data does not change too much (which is my case). Also diffs are just a « borg diff » away.