News for hackers. Stuff that matters.
Re:Show HN: Baxx – Unix-friendly backup service by garettmd on Monday March 25, 2019 @11:44AM (#19483528)
Does anyone know how it compares to Restic? That's what I've been using and have been pretty pleased. It seems like the main difference is that restic supports integrations with other services, whereas Borg seems uses SSH for its connections
Re:Show HN: Baxx – Unix-friendly backup service by johntash on Monday March 25, 2019 @01:10PM (#19484346)
I've used both Borg and Restic pretty heavily. I settled on Restic because it was much lighter on resources. A few of the servers I manage have small amounts of ram, but large amounts of data. Borg would often get oom-killed, but Restic wouldn't.

Restic also starts uploading changes as soon as it sees them, whereas borg has to scan the entire list of files before it starts uploading changes. Unfortunately for multi-tb datasets with millions of files, borg would take hours just to scan all of the files.

Pruning old archives also worked a lot better in Restic compared to Borg.

If you're happy with Restic, I'd keep sticking with it.

Re:Show HN: Baxx – Unix-friendly backup service by linsomniac on Monday March 25, 2019 @03:54PM (#19486151)
Interesting. I had deployed restic to my fleet of 100 servers around a year ago to backup to a common Backblaze B2 destination, and rolled it back after running into a production service getting OOM killed because of restic memory use.
Re:Show HN: Baxx – Unix-friendly backup service by johntash on Monday March 25, 2019 @05:26PM (#19486884)
That's interesting, did you have a lot of small files or large files?

I don't know if it's an option for you, but have you considered something like rsync from each server to a central backup server and then running restic/borg/whatever on that server? Sometimes that works out nicely too, and would be less impactful to other services on the machine.

What did you switch to instead of restic, if you don't mind me asking?

Re:Show HN: Baxx – Unix-friendly backup service by StavrosK on Monday March 25, 2019 @11:54AM (#19483632)
Restic looks pretty interesting, I wasn't aware of it, thank you. I don't know how Restic can achieve its goals, since AFAIK you need a binary running on the server to diff/check data/verify restores/etc without transferring all that over the network.

Borg runs a binary on the server to do this, that's why it can't easily back up to S3 et al.

Re:Show HN: Baxx – Unix-friendly backup service by johntash on Monday March 25, 2019 @01:15PM (#19484388)
IIRC Restic keeps indexes of data it uploads to configured backends. I think it caches that index locally, but it can also download it from the remote backend to compare.
Re:Show HN: Baxx – Unix-friendly backup service by spasche on Monday March 25, 2019 @02:04PM (#19484950)
One big disadvantage of restic at the moment is that it doesn't do compression (https://github.com/restic/restic/issues/21).

I was using restic and switched to borg because of that and could save hundreds of gigabytes.

Re:Show HN: Baxx – Unix-friendly backup service by mholt on Monday March 25, 2019 @02:17PM (#19485126)
IMO compression in backups is overrated. (I run Relica, a backup service built atop restic: https://relicabackup.com)

Most large files are already in compressed formats: mp4, zip, tgz, jpg, etc.

What you _really_ want is deduplication (which restic does), so that chunks are only stored once, even if multiple machines sharing some data back up to the same repo. Dedup saves me about 30% per backup repo in my own experience.

Not saying compression wouldn't be nice (to have done properly, it is somewhat at odds with encryption), but I'm just saying I don't think it's worth making it a #1 deciding factor.

Re:Show HN: Baxx – Unix-friendly backup service by johntash on Monday March 25, 2019 @05:30PM (#19486914)
I agree that compression is overrated for most backups. It'd help with a lot of text-oriented data, but honestly that takes up so little space compared to a vm image or something like that.

If I was backing up a single computer, compression would matter more to me. But if I'm backing up 10s or 100s of servers, there's going to be a lot of duplicated data that would make a much bigger difference.

Re:Show HN: Baxx – Unix-friendly backup service by ekovarski on Monday March 25, 2019 @03:21PM (#19485865)
You can always back up onto a compression enabled file system to further save space + dedupe with rustic.

Borg is a fantastic tool but the time it takes to start and parse the files req on a large system negates the benefits of compression for me unfortunately.

Re:Show HN: Baxx – Unix-friendly backup service by rakoo on Monday March 25, 2019 @04:23PM (#19486436)
Encryption totally defeats any raw compression. It would need to be inside the blobs themselves.
Re:Show HN: Baxx – Unix-friendly backup service by TheWiseOne on Monday March 25, 2019 @01:48PM (#19484769)
Restic also works on Windows, whereas Borg doesn't (yet), if that's a consideration.
Re:Show HN: Baxx – Unix-friendly backup service by spasche on Monday March 25, 2019 @02:00PM (#19484903)
I use it on Windows via the Linux Subsystem of Windows 10. It's not a pure native solution, but it works quite well for me.
Re:Show HN: Baxx – Unix-friendly backup service by BeeOnRope on Monday March 25, 2019 @09:30PM (#19488470)
Is "it" Borg or Restic here?
Re:Show HN: Baxx – Unix-friendly backup service by spasche on Tuesday March 26, 2019 @04:31AM (#19490072)
it = Borg
Re:Show HN: Baxx – Unix-friendly backup service by ZoomZoomZoom on Monday March 25, 2019 @06:17PM (#19487247)
It works very well under Cygwin, so no problem, if you can install that.
Re:Show HN: Baxx – Unix-friendly backup service by JoshTriplett on Monday March 25, 2019 @01:30PM (#19484554)
I've been quite happy with Restic, doing always-incremental encrypted backups to S3.
Re:Show HN: Baxx – Unix-friendly backup service by marceloneil on Monday March 25, 2019 @11:50AM (#19483593)
Borg is also big on deduplication
Re:Show HN: Baxx – Unix-friendly backup service by mrighele on Monday March 25, 2019 @01:40PM (#19484660)
Deduplication is one the things that drove me to Borg: it has the speed and space saving of an incremental backup but every single backup can be used as it was a full backup.

It is also very easy to setup a pruning policy for old backups, so that you can say that you want to keep one backup per day for 90 days and after that only one backup per month for 2 years.

Re:Show HN: Baxx – Unix-friendly backup service by bloopernova on Monday March 25, 2019 @02:07PM (#19484995)
The dedupe in Borg is downright magical. I know I lose some space by keeping my hosts in separate repositories, but even then, I get insane space savings.