News for hackers. Stuff that matters.
Re:Show HN: Zero – Local file system transparently swapping ... by nine_k on Sunday September 09, 2018 @08:30PM (#17948569)
I think Borg or Tarsnap use the right approach here: a map of blocks, updating a file updates only the changed block(s). It balances the efficiency of updates and the completeness of the copy. Sort of like FAT filesystem, only with block-level deduplication built in.

Of course you don't get a nice mirror of your files right in the cloud, unless you run a separate server that reconstructs it and makes available as traditional buckets.

Re:Show HN: Zero – Local file system transparently swapping ... by h1d on Sunday September 09, 2018 @08:59PM (#17948674)
restic and duplicacy are the newer implementations of block level dedup encrypted backup.

From what I tested, restic has friendlier command line options but duplicacy is technically superior at this point (restore works way faster)

Re:Show HN: Zero – Local file system transparently swapping ... by mappu on Monday September 10, 2018 @12:59AM (#17949492)
Restic's restore isn't parallelized at all, whereas its backup is. It should be straightforward to improve the restore performance.

https://github.com/restic/restic/pull/1719

Re:Show HN: Zero – Local file system transparently swapping ... by DEADBEEFC0FFEE on Monday September 10, 2018 @01:24AM (#17949573)
I use a Rubric appliance, that does block level dedupe and extends to cloud. I was able to instantiate a multi TB db, from the backup to a physical server in minutes. Extremely impressed .
Re:Show HN: Zero – Local file system transparently swapping ... by konschubert on Monday September 10, 2018 @03:02AM (#17949940)
I decided against a block- level system with Zero because I'm trying to make predictions about which files will be needed next locally and that's hard on a block level, I think.
Re:Show HN: Zero – Local file system transparently swapping ... by AmrMostafa on Sunday September 09, 2018 @08:42PM (#17948621)
I am wondering if there is a backup solution that works that way but without requiring a manual time consuming invocation.

Using something like inotify to record changed files and a worker in the background to immediately sync. Like dropbox.

Re:Show HN: Zero – Local file system transparently swapping ... by hemancuso on Sunday September 09, 2018 @08:45PM (#17948626)