News for hackers. Stuff that matters.

Ask HN: Is there a good, zero-knowledge backup and synchronisation program?

Hi HN, like everyone else, I need a good program that will backup and synchronise my files across computers. I don't trust Dropbox with all my data, so I came across SpiderOak and paid for a yearly account.

However, SpiderOak takes up 100% of my CPU for minutes on end, regularly freezes in some states, and a few days ago it stopped working altogether (it refuses to synchronise, it just sits there taking up all my CPU and even my attempts to reinstall it have been thwarted as it freezes on "Downloading data").

Is there a reliable, zero-knowledge program that will backup and synchronise data across computers? It's something indispensable but I'm disappointed with how buggy SpiderOak is, and all the alternatives I've seen are either backup-only or not zero-knowledge...

I'd appreciate any help!

( 15 comments | 3 points | on HN )
Re:Ask HN: Is there a good, zero-knowledge backup and synchr... by srjk on Friday April 08, 2011 @08:40AM (#2423479)
I've used unison in the past and liked it. May not fulfill the "zero knowledge" criteria but IIRC it's fairly simple to set up.

http://www.cis.upenn.edu/~bcpierce/unison/

Re:Ask HN: Is there a good, zero-knowledge backup and synchr... by StavrosK on Friday April 08, 2011 @09:05AM (#2423561)
Unison does fulfill the zero-knowledge criteria, but it's not a daemon that runs constantly, although I might give it a shot, thank you.
Re:Ask HN: Is there a good, zero-knowledge backup and synchr... by jrsmith1279 on Friday April 08, 2011 @08:23AM (#2423440)
You might look at Egnyte or Jungle Disk. We've used Egnyte for a few of our clients and had mixed results with reliability. Luckily they give you a 30 day trial, so you can try it out. Their pricing is also pretty decent.
Re:Ask HN: Is there a good, zero-knowledge backup and synchr... by StavrosK on Friday April 08, 2011 @08:30AM (#2423460)
Thank you, both of those look good. Your comment reminded me of AeroFS, a synchronisation program that's peer to peer. I should give that a shot too, as it doesn't need to be zero-knowledge if nobody other than my computers see my data...
Re:Ask HN: Is there a good, zero-knowledge backup and synchr... by aquark on Friday April 08, 2011 @09:26AM (#2423638)
I've been running the AeroFS beta for a couple of weeks and am very happy with it.

Nothing high volume or stressful, but it has done what it said it would quickly and efficiently, and the client even worked behind the moderately aggressive filters we have at work.

Re:Ask HN: Is there a good, zero-knowledge backup and synchr... by StavrosK on Friday April 08, 2011 @09:40AM (#2423699)
I just installed it, apart from the fact that it gave me an "AeroFS Drive" I can't remove (I suspect the older version installed this but the new one deprecated it) and the fact that I can't sync any two arbitrary folders, it looks perfect.
Re:Ask HN: Is there a good, zero-knowledge backup and synchr... by wladimir on Friday April 08, 2011 @09:01AM (#2423541)
I use Duplicity for remote incremental encrypted backups.

http://duplicity.nongnu.org/

It fulfills the "zero-knowledge" and reliable criteria. It's based on rsync. I'm not sure whether you can use it for synchronisation, though, never tried that.

Re:Ask HN: Is there a good, zero-knowledge backup and synchr... by StavrosK on Friday April 08, 2011 @09:03AM (#2423547)
I use duplicity+S3 as well for backups, it's the best for that. Hmm, I might sync everything to my home NAS and back it up to S3 with duplicity, now that you mentioned it, it might actually be cheaper.

Thanks!

Re:Ask HN: Is there a good, zero-knowledge backup and synchr... by sidmitra on Friday April 08, 2011 @09:00AM (#2423539)
Also any of these cloud backups solutions available, that run on Ubuntu?

i know of Ubuntu One, wondering if there're cheaper/better alternatives.

Re:Ask HN: Is there a good, zero-knowledge backup and synchr... by StavrosK on Friday April 08, 2011 @09:04AM (#2423553)
Oh, yes, I forgot to mention, I run Ubuntu so that's a pretty big prerequisite :)
Re:Ask HN: Is there a good, zero-knowledge backup and synchr... by JoachimSchipper on Friday April 08, 2011 @08:57AM (#2423529)
Any reason you can't use truecrypt/whatever your favourite OS provides on top of Dropbox?
Re:Ask HN: Is there a good, zero-knowledge backup and synchr... by StavrosK on Friday April 08, 2011 @09:05AM (#2423556)
Yes, Dropbox will have to up/download the entire multi-gigabyte file container each time, as far as I know.
Re:Ask HN: Is there a good, zero-knowledge backup and synchr... by JoachimSchipper on Friday April 08, 2011 @09:11AM (#2423585)
I'm pretty sure that Dropbox uses [EDIT: was "something like the rsync algorithm."] something like Tarsnap's algorithm: break a file into data-dependent blocks and upload all changed blocks (optionally with rsync). (For a toy implementation, let everything between two NUL bytes be a "block" - you see how this is a big win for detecting changes and deduplication.) This is supported by e.g. http://serverfault.com/questions/52861/how-does-dropbox-vers....

TrueCrypt and alternatives definitely make sure that writing one unencrypted sector only changes one encrypted sector worth of data - compare their performance with gpg'ing the entire disk on each write, and you'll quickly see why.

Re:Ask HN: Is there a good, zero-knowledge backup and synchr... by StavrosK on Friday April 08, 2011 @09:12AM (#2423590)
Hmm, I will have to look into that, although I think that Dropbox only does per-file diffing... Thanks for the recommendation.

EDIT: Interesting, that makes the TrueCrypt suggestion not only viable, but desirable. Thank you.

Re:Ask HN: Is there a good, zero-knowledge backup and synchr... by pasbesoin on Friday April 08, 2011 @12:40PM (#2424555)
A past (small) discussion of this -- mostly just a link to information on the Dropbox forums:

http://news.ycombinator.com/item?id=2043191