News for hackers. Stuff that matters.
Re:Xz format inadequate for long-term archiving by pmoriarty on Saturday October 22, 2016 @11:45AM (#12769126)
When I use xz for archival purposes I always use par2[1] to provide redundancy and recoverability in case of errors.

When I burn data (including xz archives) on to DVD for archival storage, I use dvdisaster[2] for the same purpose.

I've tested both by damaging archives and scratching DVDs, and these tools work great for recovery. The amount of redundancy (with a tradeoff for space) is also tuneable for both.

[1] - https://github.com/BlackIkeEagle/par2cmdline

[2] - http://dvdisaster.net/

Re:Xz format inadequate for long-term archiving by lucaspiller on Sunday October 23, 2016 @12:16AM (#12771919)
I recently did the same, but used tar without compression. For starters most of the data I was archiving didn't compress well (like photos), but mainly if par2 fails, I can still recover at least some of the data.

With compressed files you usually need it to be perfect to recovery any data, but you can use fixtar [0] to recover some data from a corrupted tar archive.

I used BluRay as the media cost is about the same as DVDs per GB here (at least 25GB discs). Also there are HTL discs available, which supposidely have a greater longevity than DVDs.

[0] -http://riaschissl.bestsolution.at/2015/03/repair-corrupt-tar...

Re:Xz format inadequate for long-term archiving by voltagex_ on Saturday October 22, 2016 @01:18PM (#12769532)
How much parity data (%) do you have?

What's the oldest disc you've tested?

What do you think about PAR3?

Re:Xz format inadequate for long-term archiving by pmoriarty on Saturday October 22, 2016 @03:06PM (#12770088)
I'm afraid my archiving and testing are not very systematic. I don't usually go back and test my burnt DVDs, except when I need to get data off of them, which is not very often. But so far I haven't run in to issues, and have been pretty lucky with the DVDs I've used. I don't think I can recall a situation where dvdisaster actually had to recover from errors on any old DVD. Of course, it's a good idea to transfer valuable data from old DVDs to new ones every now and then, as they won't last forever.

I just tried a DVD from 2013 (Verbatim DVD-R, 16x, 4.7 GB) and it read fine, without any errors, and dvdisaster found that the checksums on it matched.

I usually try to use at least 20% redundancy, but will settle for less if the data's not very important. If the data's really important I'll max out the amount of redundancy (up to dvdisaster's limit, which I don't remember off-hand). Sometimes I'll even burn an extra DVD with the same data, both with dvdisaster error correction on them.

As for par3, I only heard about it for the first time today in this thread. So I have no opinions on it except to say that if it's an improvement over par2, I'm all for it. Backwards compatibility with par2 also would be nice.

Re:Xz format inadequate for long-term archiving by voltagex_ on Sunday October 23, 2016 @08:49PM (#12776165)
Thanks for the info

Shame about the status of the dvdisaster project - as of 2015 the Mac OS X and Windows ports are discontinued.

Re:Xz format inadequate for long-term archiving by pmoriarty on Tuesday October 25, 2016 @01:34PM (#12789865)
That's just for the new versions. You should still be able to get the old versions and those should still work just fine.