Re:LTO Tape data storage for Linux nerds
by dmitrybrant on Thursday January 27, 2022 @09:50AM
(#30101216)
If I'm not mistaken, the tape drive automatically adds ECC to each written block, and then uses it to verify the block next time you read it. So if there's bit rot on the tape (i.e. too much for ECC to fix), it will just be reported as a bad block with no data, and there wouldn't be any point of adding "second-order" ECC from the user end.
[ Parent
| on HN ]
Re:LTO Tape data storage for Linux nerds
by metabagel on Thursday January 27, 2022 @10:25AM
(#30101631)
You’re exactly right. There is substantial ECC in the LTO format. If the drive can recover the data, then it’s valid.
Re:LTO Tape data storage for Linux nerds
by BenjiWiebe on Thursday January 27, 2022 @10:12AM
(#30101474)
There might be a point if you interleaved data and/or had a much higher amount of EC, such that you could recover from isolated bad blocks.
I'm not using tapes through, I'm using ssds, flash drives, and hdds. I'm sure they have some internal ecc, but is it enough?
Re:LTO Tape data storage for Linux nerds
by dmitrybrant on Saturday January 29, 2022 @12:25PM
(#30128225)
Correct, all modern storage media perform plenty of internal ECC. That's basically what "bad sectors" means: the drive wasn't able to correct the data on that sector using ECC. The drive will never return the actual "raw" data -- it's either valid data or a bad sector. This means that if you want to add your own application-level ECC, it would need to be enough to correct an entire sector's worth of missing data. For most applications this would be a prohibitive amount of extra overhead.