News for hackers. Stuff that matters.

A comment on Restic – Backups Done Right. Parent comment

Re:Restic – Backups Done Right by mike-cardwell on Thursday October 31, 2019 @03:24PM (#21412610)
You know, I actually assumed it had compression. It looks like it will get it eventually though, so I'm not too worried. That said, I can get some benefits by compressing some of my backups myself. For example, I currently backup my postgres dbs with cron jobs like:

$ pg_dump dbname | restic backup --stdin --stdin-filename dbname.dump --tag dbname -q

With restoring as simple as:

$ restic dump latest --tag dbname dbname.dump | psql dbname

I should probably stick a gzip/gunzip between those two commands.

[ Parent | on HN ]
Re:Restic – Backups Done Right by adrianmonk on Thursday October 31, 2019 @03:51PM (#21412950)
If you stick a cheese up in there, restic will probably lose some of its ability to deduplicate.

If it does compression, then it's not an opaque process to it. But if you do it, you are essentially obfuscating the structure of the data.

[ Parent | on HN ]
Re:Restic – Backups Done Right by tatersolid on Thursday October 31, 2019 @10:37PM (#21415821)
gzip with the —rsyncable flag will still allow for deduplication. It uses a content-aware rolling checksum and resets the compression dictionary whenever that checksum has a certain number of zeros.

The result is a valid gzip file with a few percent less compression, but friendly to deduplication (which is what rsync does).

[ Parent | on HN ]
Re:Restic – Backups Done Right by mike-cardwell on Thursday October 31, 2019 @03:58PM (#21413043)
Good point. I'll stay away from cheesing up my commands and wait for it to be built in.
[ Parent | on HN ]
Re:Restic – Backups Done Right by mynegation on Thursday October 31, 2019 @04:41PM (#21413519)
What is "cheesing up"?
[ Parent | on HN ]
Re:Restic – Backups Done Right by adrianmonk on Thursday October 31, 2019 @10:12PM (#21415722)
It's what Google speech-to-text thinks I meant when I said "gzip" into my phone.
[ Parent | on HN ]
Re:Restic – Backups Done Right by sliken on Friday November 01, 2019 @04:47AM (#21417109)
Ha, I was thinking there's a new gzip competitor I needed to track down called cheese.
[ Parent | on HN ]