News for hackers. Stuff that matters.
Re:Summary of the Amazon DynamoDB Service Disruption by ghshephard on Wednesday September 23, 2015 @06:26AM (#10264228)
A pretty good post mortem, but one worrisome final comment:

"For us, availability is the most important feature of DynamoDB"

I would think that durability should be the most important feature of DynamoDB; better to have intermittent outage, or reduced capacity, but not have data loss - but perhaps there is something about DynamoDB which suggests availability is rated more highly than durability?

Re:Summary of the Amazon DynamoDB Service Disruption by EwanToo on Wednesday September 23, 2015 @06:46AM (#10264261)
I suspect they're simply trying to reassure customers that this size of outage won't happen again, not make some kind of deep mission statement..
Re:Summary of the Amazon DynamoDB Service Disruption by jMyles on Wednesday September 23, 2015 @10:51AM (#10265339)
If this is true (and I think you're right), then pronouncements about "the most important feature" are probably not timely.
Re:Summary of the Amazon DynamoDB Service Disruption by stingraycharles on Wednesday September 23, 2015 @06:42AM (#10264254)
I think this is written from an ops point of view. Dynamo-based systems allow a client to wait until at least X servers have acknowledged the write, and use eventual consistency in case there is some service disruption.

I personally didnt know they used meta data tables in Dynamo, and that sounds like they lost one of the most important traits which gave Dynamo its super-high availability abilities, which is having all the cluster state in the clients rather than in the servers.

Re:Summary of the Amazon DynamoDB Service Disruption by sillypog on Wednesday September 23, 2015 @01:33PM (#10266501)
Thank you for saying that! I just read the Dynamo paper the other day and that was the first thing that jumped out at me when I read this outage description. Now I feel like I understood the paper.
Re:Summary of the Amazon DynamoDB Service Disruption by zackelan on Wednesday September 23, 2015 @09:27PM (#10269346)
Despite the name, DynamoDB is not actually an implementation of the Dynamo paper. It's influenced by those ideas, as well as the issues with scaling SimpleDB, but other than that is a from-scratch implementation.

http://www.allthingsdistributed.com/2012/01/amazon-dynamodb....

Re:Summary of the Amazon DynamoDB Service Disruption by brudgers on Wednesday September 23, 2015 @08:40AM (#10264629)
Since the \A\ in ACID is atomicity, I suspect the reading context for "availability" is CAP.
Re:Summary of the Amazon DynamoDB Service Disruption by sturadnidge on Wednesday September 23, 2015 @07:32AM (#10264389)
If I'm reading their post-outage actions correctly, they certainly align with availability > durability.

There are many things to like about DynamoDB, but one of the things I really dislike is the 'abscence of an error == success' pattern that they implement for many operations. With less frequent metadata requests, I imagine there is a greater chance of silent failures (ie availability looks fine, durability is gone).

Could be wrong though, I'm not going to pretend to know more about distributed systems than the DynamoDB developers.

Re:Summary of the Amazon DynamoDB Service Disruption by senderista on Friday September 25, 2015 @04:55PM (#10280622)
Durability is certainly not being compromised. I think they are just referring to increasing lease times. Timeouts are always a tradeoff (false alarm frequency vs. recovery time), and this event has prompted them to re-evaluate the tradeoff.

If you suspect the design of DynamoDB is sloppy, I encourage you to read this: http://cacm.acm.org/magazines/2015/4/184701-how-amazon-web-s...

Re:Summary of the Amazon DynamoDB Service Disruption by manuelflara on Wednesday September 23, 2015 @06:41AM (#10264251)
They probably said that because this was an availability outage. If this was a postmortem after some data had been lost, they would've ended it with "For us, durability is the most important feature of DynamoDB".