S3QL: an S3 FS with encryption, de-dup, immutable trees and snapshotting

Re:S3QL: an S3 FS with encryption, de-dup, immutable trees a... by drdaeman on Tuesday September 01, 2015 @08:19AM (#10151841)

Although git-annex is not a backup system, it works for me as one to backup photos, disk images, some documents etc (although I use it with hubiC and self-hosted SFTP storages, not S3). Maybe it could meet your requirements, too.

Files (or chunks, if it's enabled) are gpg-encrypted (to a key or using a symmetric passphrase) and could be stored in nearly anything that could store named blobs. Supports various modes (archival, backup, RAID-like). Performance is fair for me.

Downside is that it's not a "real" filesystem, but a git repo that tracks metadata, plus blob storage. Assistant daemon saves a lot of keystrokes, though. There is also some FUSE-based implementation, but I haven't tried it. Getting started is easy, so I suggest taking a look and toying around for half an hour. Another downside is that it - being a git repo - may have problems with storing another repositories inside. Haven't tried this, though.

[ Parent | on HN ]

Re:S3QL: an S3 FS with encryption, de-dup, immutable trees a... by rsync on Tuesday September 01, 2015 @02:08PM (#10154481)

Many hundreds of folks are pointing very similar git-annex based backup schemes to us and we're always happy to have an ultra-clueful customer such as that.

Joey and I put together a special discount rate for git-annex folks that want to point at rsync.net:

http://www.rsync.net/products/git-annex-pricing.html

[ Parent | on HN ]