Re:Prime Down: Amazon’s sale day turns into fail day
by zerotolerance on Tuesday July 17, 2018 @01:33AM
(#17547527)
The systems at Amazon are too large to leverage autoscaling. When I was there (in Marketplace) it was generally estimated that Amazon used about 80X the capacity of their entire AWS public cloud.
Re:Prime Down: Amazon’s sale day turns into fail day
by rorykoehler on Tuesday July 17, 2018 @04:53AM
(#17548281)
I find that implausible. I know they run a huge infrastructure but why would they be using 80X of their AWS public cloud? Thousands of companies if not millions at this stage use AWS and some of them are not insignificant in size.
Re:Prime Down: Amazon’s sale day turns into fail day
by abrookewood on Tuesday July 17, 2018 @01:51AM
(#17547574)
WTF? 80 times the capacity of their entire AWS infrastructure?? That seems insane.
Re:Prime Down: Amazon’s sale day turns into fail day
by caseysoftware on Tuesday July 17, 2018 @02:49AM
(#17547815)
No, the exact quote was:
> Amazon used about 80X the capacity of their entire AWS public cloud
which is probably closer to "the capacity that is available via AWS is a tiny, tiny fraction of their overall computing power.. therefore adding it back in when things are falling over doesn't actually solve any problems."
Re:Prime Down: Amazon’s sale day turns into fail day
by Dylan16807 on Tuesday July 17, 2018 @03:06AM
(#17547883)
I don't understand the difference between the wording in your post and the post you're replying to.
Re:Prime Down: Amazon’s sale day turns into fail day
by beejiu on Tuesday July 17, 2018 @05:32AM
(#17548431)
I think they are using the term 'capacity' to mean 'spare capacity'. I.e. that Amazon's entire compute usage is 80x the spare capacity, so scaling even a small amount would consume any spare capacity in AWS. Still, it seems hard to believe.
Re:Prime Down: Amazon’s sale day turns into fail day
by kaspm on Tuesday July 17, 2018 @01:23PM
(#17551381)
I interpreted it to mean:
1. he misspoke and meant "80%" of the AWS capacity, which I agree seems implausible. 2. Amazon does not run on AWS because Amazon is 80x more than all of AWS infrastructure. This also seems implausible because of Netflix. In fact, there's an article out there that said AWS exceeded Amazon's capacity within 1 quarter!
I still don't understand what that has to do with autoscaling exactly
Re:Prime Down: Amazon’s sale day turns into fail day
by martin-adams on Tuesday July 17, 2018 @03:32AM
(#17547975)
I did’t understand either. I suspect it’s the semantic difference between ‘public cloud’ and ‘infrastructure’. I don’t know what that difference is really.
OR there wasn't backpressure on a cascading failover so as services failed they increasingly failed to more and more overloaded systems
OR there WAS backpressure and it was the luck of the draw whether you were queued into an error page or got good data
OR the autoscaling couldn't keep up with the onsale window. This used to happen in ticketing a lot. Ticketmaster has a talk somewhere where they talk about warming the scaling load and server cache in anticipation of big ticketing onsales. The time it took to autoscale was just too long.