We came to the conclusion that putting files on BluRay disks or hard drives and keeping them physically separate was the best solution for the cost. The problem is that disks take a long time to burn, and external hard drives aren't the best archival medium (not to mention they don't always travel well).
Has anyone here solved the problem of data backups where bandwidth limits make pure online/cloud storage infeasible?
Hosted version: https://openphoto.me
Project page: http://theopenphotoproject.org
Source: https://github.com/photo
Ideally, we would be able to ship BluRays to a data center (USPS has terrible latency, but great bandwidth!), where they would load them into their servers. If anything happend to the local copies, we could either have them ship us back a hard drive or BluRays, or download the lost files (downstream is much faster for us, and because we are theoretically only downloading a subset of what we backed up, direct downloads are feasible).
The issue I run in to in my thought experiments is that a data center doesn't necessarily want to physically handle data shipped to them or create recovery media to ship back.
Actually, all that is really needed is a secure place to archive the BluRays. A way to view and download backed up files is a nice-to-have, but not required.
Probably not cost effective for them but that's what you're looking for, I think.
Amazon will accept delivery of hard disks and load the stored media in to S3/Glacier:
The OpenPhoto Project is what you're looking for. Open source, installable and offered as a hosted service.
Hosted version: https://openphoto.me
Project page: http://theopenphotoproject.org
Source: https://github.com/photo
I let it handle other drives, too, although I exclude my media/music/download/etc drive for simplicity.
Rather, it's an optional yes.
EDIT: Actually, it looks like they can decrypt your data to restore it on their end, so it's a no.
Of course, if you have so sensitive stuff that you cannot accept it ever being on another server in clear text then it still a no on that question.
Hosted version: https://openphoto.me
Project page: http://theopenphotoproject.org
Source: https://github.com/photo
Hosted version: https://openphoto.me
Project page: http://theopenphotoproject.org
Source: https://github.com/photo
akmiller, can we talk offline? i'd love to hear more about your ideas. (we actually have photos in mind.)
just email [email protected]
Hosted version: https://openphoto.me
Project page: http://theopenphotoproject.org
Source: https://github.com/photo
What I'm thinking is a service that uses Glacier to store my photo library and some type of front end service (like dropbox) that keeps a low res version of that photo along with some meta data about it.
My reasoning for this is that we all build up pretty significant photo libraries (mines already over 60GB) and I'm always trying to make sure I have them backed up. I currently use a paid plan at Dropbox so I can put them all up there but it's kind of a waste since I hardly ever pull many of them down again. Every once in awhile I browse through them looking for certain pictures that I might need to get a copy of (which is why I'd need the low res copies easy to access/browse) and then be able to choose which ones to pull down from glacier. The other good thing about a service like that is the need is not typically immediate.
Maybe I'll look into building this since it's something I'd love to have for myself!