S3QL: an S3 FS with encryption, de-dup, immutable trees and snapshotting

Re:S3QL: an S3 FS with encryption, de-dup, immutable trees a... by stubish on Tuesday September 01, 2015 @01:15AM (#10150848)

The closest thing I've seen to this is Jungle Disk, which is closed source, offers a less fully featured file system, but does have Windows and Mac clients.

[ Parent | on HN ]

Re:S3QL: an S3 FS with encryption, de-dup, immutable trees a... by _delirium on Tuesday September 01, 2015 @01:34AM (#10150895)

There was also ObjectiveFS discussed on HN a few days ago, also closed source: https://news.ycombinator.com/item?id=10117506

Main difference appears to be that it supports concurrent mounts, while S3QL can be mounted by one client at a time.

[ Parent | on HN ]

Re:S3QL: an S3 FS with encryption, de-dup, immutable trees a... by LeoPanthera on Tuesday September 01, 2015 @02:21AM (#10150986)

Surely the "main" difference is that ObjectiveFS is a paid service with prices starting at $7/mount.

S3QL is FOSS.

[ Parent | on HN ]

Re:S3QL: an S3 FS with encryption, de-dup, immutable trees a... by porker on Tuesday September 01, 2015 @03:13AM (#10151102)

JungleDisk works, but the clients are buggy PoS that crash/hang whenever they choose. I've also had JungleDisk's server daemon silently quit working & lock up on some servers, which is scary when you go to restore a file and realise no backups have happened in a while. It doesn't engender trust.

That said, I still use it as it's easier & less error-prone than setting up my own backup system with tarsnap.

[ Parent | on HN ]

Re:S3QL: an S3 FS with encryption, de-dup, immutable trees a... by lobster_johnson on Tuesday September 01, 2015 @06:55AM (#10151638)

Seconding this. I used Jungle for a while on my laptop, and it actually runs a local WebDAV server that acts as a caching proxy, which it then mounts as a local volume -- and it's horrible. Slow, unstable and prone to mysterious hangs and errors. This was a couple of years ago, but I wouldn't trust it unless they have completely rewritten it since then.

[ Parent | on HN ]

Re:S3QL: an S3 FS with encryption, de-dup, immutable trees a... by porker on Tuesday September 01, 2015 @08:55AM (#10151976)

> This was a couple of years ago, but I wouldn't trust it unless they have completely rewritten it since then.

The software hasn't been updated since May 2011, when they released version 3.16.

[ Parent | on HN ]

Re:S3QL: an S3 FS with encryption, de-dup, immutable trees a... by jaytagdamian on Tuesday September 01, 2015 @03:36AM (#10151171)

The reporting is very poor also - if the backups don't run, you arent alerted to failure or success, they just dont appear on the emailed reports. Many a server has not been backed up because of this...

[ Parent | on HN ]

Re:S3QL: an S3 FS with encryption, de-dup, immutable trees a... by bretpiatt on Tuesday September 01, 2015 @11:28AM (#10153005)

Each backup job reports when successfully completed to provide an audit trail for your successful backups. If you are scheduled to run daily backups and you do not see the daily email the backup did not successfully run. We're open to understanding if there is a better behavior for this process. My worry is if we email on both cases people see the message come through and ignore the details where it shows 'failed'.

[ Parent | on HN ]

Re:S3QL: an S3 FS with encryption, de-dup, immutable trees a... by porker on Tuesday September 01, 2015 @11:36AM (#10153075)

Thanks for reaching out Bret. The issue I've found is it's much harder to monitor on an email NOT arriving, than one arriving with specific text. With the latter I can be as lazy as setting up a GMail fiter, with the former... I'd have to build my own reporting system that knows you'll email about 8-9am and if the email doesn't arrive, assume it's failed. That's a lot of overhead.

How to best monitor something doesn't happen (e.g. a scheduled, remote job) is something I've yet to solve.

[ Parent | on HN ]