News for hackers. Stuff that matters.
Re:Amazon Glacier by kondro on Tuesday August 21, 2012 @05:24AM (#4411906)
Home-use is probably the only situation Glacier is good for backup though.

A home user is fine with a 3.5-4 hour window before their backup becomes available for download (as it will probably take them days to download it anyway).

In a corporate environment, I don't want to wait around for 3.5-4 hours before my data even becomes available for restore in a disaster recovery situation.

Seems good for archive-only in a corporate environment (as the name implies).

Re:Amazon Glacier by ghshephard on Tuesday August 21, 2012 @05:49AM (#4411974)
Interesting to note - those of us who used Iron Mountain/Data Safe for years - 4 Hours was considered a "Premier Rapid Recovery" service that we paid a lot of money for (as recently as 2003, actually).

In a true disaster recovery (Building burned down or is otherwise unavailable) - it usually takes most businesses a week or so just to find new office facilities.

But - agreed, there will be some customers for whom Glacier wouldn't work well for all use cases.

Now - a blended S3/Glacier offering might be very attractive.

Re:Amazon Glacier by speleding on Tuesday August 21, 2012 @07:32AM (#4412207)
Yes, that's what I am thinking: a week of backups to S3 and a script that does moves the oldest one from S3 to Glacier. You would rarely need a backup older than a week if you've already got a week of backups. I'm still figuring out if there is a practical way to do this with incremental backups without introducing to much risk that the backup process gets messed up.
Re:Amazon Glacier by noibl on Tuesday August 21, 2012 @08:04AM (#4412292)
"In the coming months, Amazon Simple Storage Service (Amazon S3) plans to introduce an option that will allow you to seamlessly move data between Amazon S3 and Amazon Glacier using data lifecycle policies."
Re:Amazon Glacier by speleding on Tuesday August 21, 2012 @03:58PM (#4414465)
nice!
Re:Amazon Glacier by adrinavarro on Tuesday August 21, 2012 @09:09AM (#4412505)
It's made for archiving, not 'backups'. You're expected to keep most recent backups on-site, so if a RAID array dies or you happen to do something wrong, it just takes minutes to restore. Off-site, or tape archive, it's usually another thing. Most of the data is never, ever accessed (but required by company policy to be kept).
Re:Amazon Glacier by culturestate on Tuesday August 21, 2012 @05:39AM (#4411954)
In a corporate environment, I wouldn't want to depend on the cloud as my primary backup solution in the first place. I'd be much more comfortable using it as the offsite mirror of an onsite backup. If you're at a point in disaster recovery where you have to restore from your offsite, you (likely) have bigger problems than a 4-hour wait time.
Re:Amazon Glacier by tomp on Tuesday August 21, 2012 @07:31AM (#4412204)
I personally believe that data should never be deleted (or overwritten), but only appended to. Kinda like what redis/datomic does. So, keep live data onsite, along with an onsite (small) backup, and all the old data in Glacier.
Re:Amazon Glacier by rossjudson on Tuesday August 21, 2012 @08:34AM (#4412375)
You can believe that, but legal realities dictate otherwise. There are certain classes of information that you are not permitted to keep beyond a defined horizon, either temporal or event-based. Legal compliance with records management processes means having the ability to delete or destroy information such that it cannot be recovered. Note that if the information is encrypted, you can just delete the decryption key and it is effectively deleted.
Re:Amazon Glacier by r00fus on Tuesday August 21, 2012 @03:04PM (#4414210)
That's just the beginning - if you've ever been in a ediscovery process, having large amounts of historical data is actually a liability - if instead of 100GB you have 10TB, you'll need to hand that over, and before that, to cull it so you don't inadvertently hand the opposition a huge lever to be used against you. Processing and reviewing 10-100x the data can take inordinate amounts of time more than you expect.
Re:Amazon Glacier by pmahoney on Tuesday August 21, 2012 @10:35AM (#4412855)
> Note that if the information is encrypted, you can just delete the decryption key and it is effectively deleted.

Does this satisfy the legal requirements you mention? I assume there are further requirements on what constitutes sufficient encryption?

Re:Amazon Glacier by icefox on Tuesday August 21, 2012 @11:32AM (#4413129)
"In a corporate environment, I don't want to wait around for 3.5-4 hours before my data even becomes available for restore in a disaster recovery situation."

I am guessing you work in a company with a good IT department then, I am guessing this is not the average. Many companies I have worked for 4 hours would be a miracle with a 1-3 day operation minimum.

And don't forget that the X00MB type size limits many IT departments puts everywhere it not because getting a TB hard drive is cheap, but because all of the extra backups add to the cost of each new MB. Having another extremely cheap way they could backup large amounts of data (encrypted?) would help to reduce the cost of each extra GB.

Re:Amazon Glacier by gadders on Tuesday August 21, 2012 @05:54AM (#4411989)
I don't think DR is the correct use-case. I think it more likely to be (as in the case of banks which I know best) a regulator asking for electronic documents or emails relating to a transaction from 6 years ago (seven years is the retention requirement).

In that case, 3-4 hours would be more than acceptable.

Re:Amazon Glacier by webreac on Tuesday August 21, 2012 @05:32AM (#4411939)
Here, we are producing logs of simulation runs that may be needed in the next couple of years. Most of the logs will be destroyed unused. This is a perfect use case for glacier. We do not care about 5 hours recovery time.
Re:Amazon Glacier by kondro on Tuesday August 21, 2012 @05:45AM (#4411969)
Absolutely, it's an archive product, not a backup product.
Re:Amazon Glacier by greedo on Tuesday August 21, 2012 @12:22PM (#4413390)
In a corporate environment where you have low RTO goals for DR scenarios, relying on backups instead of replicated SAN etc is not a sound practice, especially with large data sets.
Re:Amazon Glacier by rsync on Tuesday August 21, 2012 @01:14PM (#4413614)
"I don't want to wait around for 3.5-4 hours before my data even becomes available for restore in a disaster recovery situation"

ding!

Re:Amazon Glacier by xbryanx on Tuesday August 21, 2012 @10:38AM (#4412866)
This would work great as a disaster recovery solution for the museum I work at. Not just for home-use.