News for hackers. Stuff that matters.
Re:AWS us-east-2 outage by wkoszek on Thursday July 28, 2022 @03:01PM (#32268748)
How do you NOT pay more for running double of everything + load balancers?
Re:AWS us-east-2 outage by poxrud on Thursday July 28, 2022 @03:21PM (#32268985)
You do not need to pay double for everything, that might have been true with traditional VPS providers but it is not the way it works with cloud services. You decide on what kind of failure you're willing to tolerate and then architect based on those requirements (loss of multiple AZ's, loss of a region, etc..).

Let's say your website requires 4 application servers, you can then tolerate a single AZ failure by using 5 application servers and spreading them among 5 AZs.

Re:AWS us-east-2 outage by nemothekid on Thursday July 28, 2022 @03:35PM (#32269151)
If you already have 4 application servers you are probably already AZ tolerant; most people concerned about "doubling everything" are only running 1 instance.

Going by your example, If your website requires 1 application server, to tolerate a single AZ failure, it requires you to double the number of application servers.

Example - we have a service that used Kafka in the affected region that went down. Our primary kafka instance (R=3) survived but this auxiliary one failed and caused downtime. There's no way around this other than doubling the cost.

Re:AWS us-east-2 outage by Nextgrid on Thursday July 28, 2022 @03:57PM (#32269377)
In most cases the elephant* in the room is your DB - it doesn't matter where your stateless application servers are, if your stateful DB goes down you're in trouble. It's also often 1) the hardest to replicate, as replication involves tradeoffs - see CAP theorem & co and 2) the most expensive, since it needs to be pretty beefy in terms of CPU, RAM and IO - all very expensive on AWS.

*: https://commons.wikimedia.org/wiki/File:Postgresql_elephant....

Re:AWS us-east-2 outage by poxrud on Thursday July 28, 2022 @03:53PM (#32269331)
That's true, when only dealing with 1 server, you technically double the cost by adding a second server. My original comment was about "popular sites/services", that should be able to tolerate the costs and are most likely dealing with multiple servers.

For a single server deployment you can still reduce your downtime (with minimal costs) by having the ASG redeploy into another AZ on a failed health check.

Re:AWS us-east-2 outage by jjav on Thursday July 28, 2022 @04:09PM (#32269499)
Those stateless app servers are the easy part. But you need to be replicating the data, with all the cost and complexity decisions that comes with it.