News for hackers. Stuff that matters.
Re:Amazon Glacier by g-garron on Tuesday August 21, 2012 @08:07AM (#4412303)
I use a combination of Dropbox and S3.

I have my MacBook and a Linux server linked to my Dropbox account. So changes in my documents are synced to my Linux.

My Linux run three cron-jobs. One daily, one weekly and another monthly. The command is.

s3cmd sync --delete-removed ~/Dropbox/documents/ s3://backup-daily/

There are buckets for weekly and monthly too.

Note: the command is not exactly like that, check the man page.

That way I have backed up all my documents very cheap.

Re:Amazon Glacier by ghshephard on Tuesday August 21, 2012 @08:18AM (#4412325)
One thing to be a little careful of - you are sending all of your data to S3, which is, of course, the backing store for Dropbox.
Re:Amazon Glacier by sintaks on Wednesday August 22, 2012 @01:50AM (#4416214)
Dropbox stores their stuff in S3 a little different. It's not a 1:1 correspondence between user files and objects under Dropbox's S3 account. The fact that they use S3 as their backing store means very little. It certainly sounds good to have S3 in back when you talk about scalability and durability, but 1) they could just as easily use something else, and 2) depending on their sharding strategy, a single lost object could impact multiple files at the user level.
Re:Amazon Glacier by ghshephard on Wednesday August 22, 2012 @04:26PM (#4419395)
Right - the point I was trying to make, is he was putting all his eggs in one basked. If anything catastrophic happened to S3, he might lose both his S3 as well as his Dropbox backups.

If you are going to the effort of having dual-backup systems, may as well try and find something that can't be impacted by a single disaster.

Re:Amazon Glacier by sintaks on Wednesday August 22, 2012 @08:27PM (#4420295)
Ah, right - definitely.
Re:Amazon Glacier by DeepDuh on Tuesday August 21, 2012 @08:21AM (#4412339)
Wait, do I understand this correctly: You sync your dropbox to S3? Do you overwrite your previous daily when you do so?
Re:Amazon Glacier by g-garron on Tuesday August 21, 2012 @09:28AM (#4412578)
Yes I do it, I have the weekly and monthly.

And yes, I might have daily-monday / daily/tuesday.... and so on, and it would work better, but this way works for me. There is a lot of room for improvement, and it is not hard to implement with cron-jobs and more buckets.

Re:Amazon Glacier by DeepDuh on Tuesday August 21, 2012 @07:00PM (#4415235)
Do you know about worst case analysis?

Let's say your data loss occurs on the Sunday, 31th of a month at 23:55 and then gets synched across all your S3 backups (or it could occur at some point before that but you don't notice it). And poof goes your data.

Re:Amazon Glacier by tedunangst on Tuesday August 21, 2012 @08:25PM (#4415496)
THIS. I'd say at least half of the time I went to retrieve a good revision of a file from backup, it was already too late and the backup was trash as well.
Re:Amazon Glacier by sintaks on Wednesday August 22, 2012 @01:45AM (#4416208)
He could just turn on object versioning.
Re:Amazon Glacier by narsil on Tuesday August 21, 2012 @06:33PM (#4415141)
You could try adding objects with the date in their names to a 'backup' bucket rather than create separate buckets for each backup. S3 also supports object expiration, so you can set your daily backups to expire after 7 days and weekly backups to expire after 4 weeks, for example.