News for hackers. Stuff that matters.
Re:SSD Prices in a Free Fall by hbbio on Monday June 22, 2015 @01:26PM (#9759797)
In a side-note in the article, the author mentions that Amazon Glacier runs on tape. Although I'm not sure Amazon officially explained the technology, I heard (and read on Wikipedia) that they store data on conventional HDDs, that are however kept "offline".

Has anyone here some more knowledge about that?

Re:SSD Prices in a Free Fall by stephenjudkins on Monday June 22, 2015 @01:37PM (#9759881)
Here's one theory: https://storagemojo.com/2014/04/25/amazons-glacier-secret-bd... and here's the HN thread: https://news.ycombinator.com/item?id=7647571

Facebook uses Blu-ray discs with a robotic storage system for its cold storage: http://www.datacenterdynamics.com/it-networks/robot-digs-thr...

Re:SSD Prices in a Free Fall by agumonkey on Monday June 22, 2015 @03:15PM (#9760558)
It would be nice if Facebook released some stats, kinda like backblaze, about blu-ray durability.
Re:SSD Prices in a Free Fall by sliverstorm on Monday June 22, 2015 @03:31PM (#9760649)
I thought degradation of optical medium was already pretty well understood? (And happened on timescales generally longer than FB has been in operation)
Re:SSD Prices in a Free Fall by stephenjudkins on Monday June 22, 2015 @08:08PM (#9761949)
There is Blu-ray compatible archival disk format that the manufacturers claim will last 1000 years: https://en.wikipedia.org/wiki/M-DISC

I don't know how this claim could be verified in our lifetimes.

Re:SSD Prices in a Free Fall by kale on Tuesday June 23, 2015 @09:08AM (#9764351)
I've done accelerated aging on polymers (medical, but I bet it's similar).

We have an accelerated aging experiment, and we sample the part for degradation throughout the test. We also "shelf age" another test group of polymers from the same batch by placing them on the shelf.

Every year or so (or sometimes 5 year spans), we take the shelf samples and look for degradation, and compare it to the accelerated data.

In one polymer's specific case, free radicals in the polymer chain slowly react with oxygen and that's how it breaks down (takes about 10 years if the polymer isn't stable), so our accelerated aging is to put in in a pressure vessel full of high-pressure oxygen, and apply a little heat. We can get 10 years of degradation (roughly) within 2 weeks.

This is almost certainly what the archival blu-ray format has done and is doing.

Re:SSD Prices in a Free Fall by agumonkey on Monday June 22, 2015 @03:37PM (#9760675)
I was too young at the time optical medium was everywhere to search for actual data, and public claims were contradictory (5 years, 10 years .. more .. ). And that was CD-ROM density.

Interestingly, http://blog.digistor.com/the-unparalleled-durability-of-blu-... says that there were new design constraint in blurays making them much more durable.

Re:SSD Prices in a Free Fall by deftnerd on Monday June 22, 2015 @03:41PM (#9760690)
Perhaps Amazon's Glacier center operates in a lights-out environment with a decreased oxygen environment to increase the life span of the discs.
Re:SSD Prices in a Free Fall by atYevP on Tuesday June 23, 2015 @11:55AM (#9765480)
Yev from Backblaze here -> Yea, we always kind of hope that others will jump in and start sharing data as well. We'll see!
Re:SSD Prices in a Free Fall by JimmaDaRustla on Monday June 22, 2015 @01:33PM (#9759850)
I'm probably explaining something most everyone here already knows, but:

I don't know what Glacier uses, but the "offline" storage is much the same how mainframes use tape - disk based files (datasets in mainframe speak) are migrated to tape after a given amount of time to decrease storage costs. These datasets needs to be recalled back to disk to be used again. This is nearly identical to how Glacier operates with S3 as explained by Amazon.

The reason tape isn't available immediately is because the tape drive, unlike a traditional harddrive, doesn't contain a reader. So multiple tapes typically sit in machines with only only a few readers that move back and forth based on requests made to read the tapes. If there are many requests, the amount of time to recall a dataset increases.

Glacier may or may not be using tape, but the behavior is nearly identical to how tape has been used in past systems.

Re:SSD Prices in a Free Fall by Someone on Monday June 22, 2015 @02:37PM (#9760302)
You're referring to https://en.m.wikipedia.org/wiki/Hierarchical_storage_managem.... AFAIK, most systems work at the file level, but if you address space is large enough, you could implement this as a virtual memory system that swaps RAM to disk, disk to slower disk, slower disk to tape, tapes to tapes stored offline, etc.

I don't know what Amazon uses, either, but I expect Glacier data to be pushed out to some layer that doesn't need power while idle at all, heavily checksummed and also replicated across the globe. The relatively heavy prices tag for accessing it probably is there to keep contention on some relatively thin pipe low. For example, if they use blue ray, they may have only a few readers online for every 100 or 1000 customers, both to keep prices low and to differentiate Glacier more from their other products.

Re:SSD Prices in a Free Fall by icebraining on Monday June 22, 2015 @04:14PM (#9760885)
if you address space is large enough, you could implement this as a virtual memory system that swaps RAM to disk, disk to slower disk, slower disk to tape, tapes to tapes stored offline, etc.

Funny to imagine,

  - My program has been stuck copying a variable for over half an hour!
  - Yeah, there was a page fault and the tape loading guy still hasn't come from lunch
Re:SSD Prices in a Free Fall by Someone on Monday June 22, 2015 @04:54PM (#9761128)
Yes, but the other side of the coin is "why are those pages of the program still on disk? They haven't been touched in years". But such systems tend to keep parts under human control.

You rarely ever need your fire extinguisher, but that doesn't mean the LRU replacement algorithm that keeps your house clean can move them to the back of your attic.

Re:SSD Prices in a Free Fall by JimmaDaRustla on Tuesday June 23, 2015 @02:07PM (#9766465)
True.

Back in the day, before automated tape readers, tapes were stored in silos, like a library, and employees would find the cataloged tapes and manually retrieve and load them into tape readers. My company use to hire co-ops to do this back in the 70s or so.

Re:SSD Prices in a Free Fall by ghaff on Monday June 22, 2015 @02:34PM (#9760274)
Nothing authoritative. The links down-thread are almost all Robin Harris speculating about what it might be based on using various back of the envelope calculations. I'm actually pretty amazed that Amazon has been able to keep even minimal details off the web as far as I can tell.

The closest I've seen to a direct statement from Amazon is: " An Amazon statement sent to Ars says only that "Glacier is built from inexpensive commodity hardware components," and is "designed to be hardware-agnostic, so that savings can be captured as Amazon continues to drive down infrastructure costs."" http://arstechnica.com/information-technology/2012/08/for-on...

FWIW, Google's competitive Nearline service almost certainly uses disks:

The difference between Google’s Standard Storage and Nearline Storage slices on its public cloud comes down to a software layer, Tom Kershaw, director of product management for Google Cloud Platform, tells The Platform. We also think there might possibly be extra physical distance between the devices hosting the Nearline Storage and servers residing in the Google datacenters and network links that expose Cloud Platform services to the outside Internet. The Nearline Storage could also be running on slightly older equipment that is heavier on the disk drives but that is not beyond its technical or economic life.

http://www.theplatform.net/2015/03/16/why-the-coldest-storag...

Re:SSD Prices in a Free Fall by arca_vorago on Monday June 22, 2015 @02:24PM (#9760220)
I think a lot of people may have confused Google's tape storage systems for Amazon's. I don't think Amazon is using tape, but the big G most definitely is:

https://www.google.com/about/datacenters/gallery/images/_300...

Re:SSD Prices in a Free Fall by bglusman on Monday June 22, 2015 @01:32PM (#9759839)
It was never confirmed, but I recall this[1] article making a pretty persuasive case Glacier was using optical disks.

[1]https://storagemojo.com/2014/04/25/amazons-glacier-secret-bd...

Re:SSD Prices in a Free Fall by discodave on Monday June 22, 2015 @01:54PM (#9759995)
Pretty sure Amazon said publicly that they are not using tape for Glacier, I can't find the source except this second hand one:

https://storagemojo.com/2014/04/25/amazons-glacier-secret-bd...

Re:SSD Prices in a Free Fall by _dark_matter_ on Monday June 22, 2015 @01:29PM (#9759825)
Yes please. I was also intrigued by this statement. I was under the impression that Amazon never told what the "secret sauce" was behind Glacier. Looking at Wikipedia now, it seems there are still multiple contending theories.

Also, is it true that the service is not very popular? Are people here using it or similar?

Re:SSD Prices in a Free Fall by teraflop on Monday June 22, 2015 @02:34PM (#9760277)
The big sticking point with Glacier is that the cost model for retrievals is complicated and unintuitive. There's a two-step process where you have to first retrieve data and then download it, and you're billed based on the peak retrieval rate in a month, not the total amount downloaded. It's not so bad now that they let you set a retrieval policy to limit your throughput, but before that, you had to carefully schedule your retrievals in order to avoid unexpected costs.

As far as I can tell, Google's new nearline storage offering is superior to Glacier in nearly every way. The retrieval is much faster, and the retrieval costs are a flat rate per gigabyte that's equal to what Glacier gives you in the best case. Only drawback is the lack of a free tier.

Re:SSD Prices in a Free Fall by discodave on Monday June 22, 2015 @05:41PM (#9761403)
You're not wrong, but if you look at the problem that Glacier is trying to solve then it doesn't look so bad:

1. Glacier is competing with tape. So for potential customers, if it's easier to acquire and maintain than your own tape library then that's a win.

2. In the words of James Hamilton the use case for Glacier is referred "jokingly to as Write Only Storage". If you're using Glacier for disaster recovery then paying a one time cost to retrieve a bunch of data pales in in comparison to the potential costs of not being able to recover your data.

3. Is nearline actually superior for the case of "oh shit I need to retrieve everything right now"?

4. AWS already has this cloud storage thingy called S3 and it has reduced redundancy storage if you're looking for something slightly cheaper.

http://perspectives.mvdirona.com/2012/08/glacier-engineering...

Re:SSD Prices in a Free Fall by teraflop on Monday June 22, 2015 @08:14PM (#9761966)
I guess you've got a good point as far as #3 goes; the analysis is actually more interesting than I thought it was. Both Google's nearline storage and Glacier scale your retrieval capabilities proportionally to how much data you have stored with them. You can express it as a tradeoff between cost/GB and the time taken to retrieve your entire dataset

Google throttles your downloads to a fixed rate, so they're effectively forcing you to one point in that space: (3 days, $0.01/GB). With Glacier, you get a curve depending on how fast you want it. It's much more expensive at the same speed (3 days, $0.10/GB) but you can go to one extreme of getting all your data for free over the course of 20 months, or getting it all within 4 hours for about $1.80/GB.

So I guess it's fair to say that Glacier gives you more flexibility, but Google's offering is a much better value at the particular point that it optimizes for.

Re:SSD Prices in a Free Fall by Dylan16807 on Monday June 22, 2015 @10:28PM (#9762313)
Honestly it's hard for me to imagine a total emergency restore-EVERYTHING situation that needs the data in under a day.

If it's not that much data you should have a local copy anyway. If it's massive amounts of data is your connection even that fast? And how did you wipe 50 servers at once?

Re:SSD Prices in a Free Fall by vidarh on Tuesday June 23, 2015 @06:07AM (#9763637)
> And how did you wipe 50 servers at once?

Fire does that quite easily...

Re:SSD Prices in a Free Fall by Dylan16807 on Tuesday June 23, 2015 @04:21PM (#9767511)
That's destruction, not wiping. If you are buying new servers as part of rebuilding you don't exactly need all the data downloaded in a 10 hour window.
Re:SSD Prices in a Free Fall by vidarh on Thursday June 25, 2015 @12:56AM (#9776038)
That's an absolutely irrelevant distinction: The data is gone.

And why, in this day of rapid provisioning via cloud providers, do you expect a company to suffer the extended loss of waiting for new servers to want to bring the data back?

Re:SSD Prices in a Free Fall by Dylan16807 on Thursday June 25, 2015 @04:46AM (#9776651)
So you're talking about a company using entirely physical servers and switching to an entirely virtual infrastructure, while also dealing with the other effects of the disaster that hit them.

They're doing this in less than half a week, or assuming not all the backups are live data they're doing this in less than a day.

I submit that this is an extremely atypical company, and that in practice a company that just had a devastating fire is not going to be impacted more than marginally by the download speed limit.

There are a good few scenarios where there's total data loss. There are much fewer where you need to restore all the data in under a working day.

Re:SSD Prices in a Free Fall by kstrauser on Monday June 22, 2015 @02:11PM (#9760146)
My home Synology unit does nightly backups to Glacier. It'd be terrible to lose our house to natural disaster, but losing all our digital data (photos, records, etc.) would make it just that much worse. For about $10 a month, I know I can recover all that stuff even if we lose everything else.
Re:SSD Prices in a Free Fall by JimmaDaRustla on Monday June 22, 2015 @01:37PM (#9759876)
I'm using it for incremental backups of my photo collection. If I ever need to restore my entire collection, its available on S3/Glacier.
Re:SSD Prices in a Free Fall by takasc2 on Monday June 22, 2015 @01:34PM (#9759857)
Everyone knows it is not very popular - the limitations are extreme so you have to have a very specific use case for it.
Re:SSD Prices in a Free Fall by SixSigma on Monday June 22, 2015 @02:02PM (#9760072)
Tape is guaranteed for 10 years without data loss
Re:SSD Prices in a Free Fall by wmf on Monday June 22, 2015 @04:41PM (#9761048)
Yet Google is using RAID-4 for their tape backups.