News for hackers. Stuff that matters.
Re:Real world SSD wearout by ApolloFortyNine on Monday August 27, 2018 @04:07PM (#17854051)
Most definitely yes.

But in addition to this, standard Raid5 does not periodically read the data, so it's actually rather common for issues to only arise on a resilver.

This is why proper maintenance in ZFS is to run ZFS Scrub (basically check every file) once a week.

Re:Real world SSD wearout by agapon on Tuesday August 28, 2018 @03:27AM (#17857096)
Once a week sounds extreme unless we talk about a smallish SSD-only pool. You may wear out your (spinning) disks with scrubs more than you do with real workloads. Also, depending on a pool size it may take days for a scrub to complete.
Re:Real world SSD wearout by mmt on Tuesday August 28, 2018 @02:31PM (#17861490)
> You may wear out your (spinning) disks with scrubs more than you do with real workloads.

This seems like an extraordinary claim requiring extraordinary evidence, especially since the notion of wear out is only applicable to SSDs (as shorthand for write endurance).

I certainly believe that mechanical disks, with all those moving parts, can have their failure rates increased by increased use, but it's not safe to assume even something as high as a linearly proportional relationship, considering which parts move when.

Re:Real world SSD wearout by mmt on Monday August 27, 2018 @05:17PM (#17854636)
That's also proper RAID5/6 maintenance. My main/recent familiarity is with LSI hardware RAID implementation, where they call it a "patrol read". I believe mdraid has checkarray.

I'm not sure if you meant to imply that ZFS is different from standard RAID in this regard, but it doesn't seem as though it is.

Re:Real world SSD wearout by jacquesm on Monday August 27, 2018 @08:56PM (#17855804)
It's called scrubbing.
Re:Real world SSD wearout by mmt on Monday August 27, 2018 @10:10PM (#17856142)
Did you mean to reply to my above question? If so, I'm unclear as to what you're trying to get across.

Is ZFS scrubbing different than the other RAIDs' (scheduled or schedulable) reads of the entire array, other than nomenclature?

Re:Real world SSD wearout by Siecje on Monday August 27, 2018 @05:43PM (#17854831)
We use ZFS, how can I check if we are doing a ZFS Scrub every week?
Re:Real world SSD wearout by simcop2387 on Monday August 27, 2018 @05:44PM (#17854839)
'zpool status' will tell you the last time a scrub was run, or if one is running currently and information about it. Then check your crons and see that they make sense and match what you see with zpool status.
Re:Real world SSD wearout by Siecje on Monday August 27, 2018 @05:49PM (#17854875)
Well it is not every week.

> scan: scrub repaired 0 in 0h36m with 0 errors on Sun Aug 12 06:00:50 2018

I don't see any cron jobs though...

Re:Real world SSD wearout by simcop2387 on Monday August 27, 2018 @06:25PM (#17855067)
Given the speed of that, I'd bet you don't have a huge pool (or if you do, that's a really nice speed). I'd bet someone's doing it manually. That's what I do for my own systems (about once a month) since they're not heavy use (personal and parent's file servers).