News for hackers. Stuff that matters.

A comment on Building resilient services at Prime Video with chaos engineering. Parent comment

Re:Building resilient services at Prime Video with chaos eng... by simonebrunozzi on Monday August 24, 2020 @10:45AM (#24261169)
Uptime of essentially 100%. Hard to criticize when they accomplished something so rare in tech.
[ Parent | on HN ]
Re:Building resilient services at Prime Video with chaos eng... by benbristow on Monday August 24, 2020 @11:00AM (#24261320)
Just because something is up doesn’t mean it’s good.

There’s an innuendo in there somewhere...

[ Parent | on HN ]
Re:Building resilient services at Prime Video with chaos eng... by SEJeff on Monday August 24, 2020 @12:24PM (#24262186)
laughs in us-east-1
[ Parent | on HN ]
Re:Building resilient services at Prime Video with chaos eng... by scarmig on Monday August 24, 2020 @02:29PM (#24263775)
us-east-1 is part of the suite of chaos engineering tools AWS offers.
[ Parent | on HN ]
Re:Building resilient services at Prime Video with chaos eng... by simonebrunozzi on Monday August 24, 2020 @04:06PM (#24264896)
The whole point is to use multiple Availability Zones across Regions, to protect your uptime from failures in single AZs or entire Regions. Amazon.com does that.
[ Parent | on HN ]
Re:Building resilient services at Prime Video with chaos eng... by SEJeff on Monday August 24, 2020 @04:19PM (#24265049)
And yet, even companies like pager duty, who have “one job” and hire many competent engineers, still struggle with this:

https://www.pagerduty.com/blog/outage-post-mortem-june-14/

Note that pager duty now weathers Amazon outages beautifully, but the point is that amazon doesn’t have 100% uptime and that properly designing distributed systems is very hard.

[ Parent | on HN ]