[dead]
Re:Honest status reporting and AWS service status “truth”
by matt_oriordan on Friday February 10, 2017 @10:11AM
(#13615868)
Read my previous comment. We use multiple AZs. That's not the point of my blog post. I am not complaining about availability of services, I am complaining that there is no accuracy of their service status.
Re:Honest status reporting and AWS service status “truth”
by franciskim on Friday February 10, 2017 @10:15AM
(#13615905)
Well, your system is not fault-tolerant if you have cross dependencies between AZs. I find their reporting accurate - AZ outage, not Regional as per your post.
Re:Honest status reporting and AWS service status “truth”
by SEMW on Friday February 10, 2017 @10:37AM
(#13616061)
Simple thought experiment: realtime messaging system; servers in multiple AZs; user A is connected to endpoint 1 in AZ 1, user B is connected to endpoint 2 in AZ 2; A publishes a message on a channel that B is subscribed to. Then it is an error for B to not receive it. This makes network partitions (especially partial, asymmetric, or sporadic ones) a nontrivial problem. Of course there are solutions, but it's hardly as simple as "just make your app multi-AZ". Not every app is a bunch of independent boxes serving web pages.
Re:Honest status reporting and AWS service status “truth”
by dastbe on Friday February 10, 2017 @11:40AM
(#13616682)
Well what is your SLO around message delivery? If it's "a successful response means a message will be delivered at least once and in under X time" then you need to verify that message has been durably committed to multiple machines in all of your availability zones. if it's just that the message is durably committed or the SLO on delivery is long enough, then you can drop the multi-as bit.
Re:Honest status reporting and AWS service status “truth”
by aluskuiuc on Friday February 10, 2017 @12:25PM
(#13617087)
I think if your app is a cluster that requires a quorum, 2 AZs just isn't enough - you need to be running in 3 to be tolerant to one going down.
Re:Honest status reporting and AWS service status “truth”
by lotyrin on Friday February 10, 2017 @01:06PM
(#13617468)
Yep. Non-quorum members can even simply terminate existing connections and refuse new connections from clients, so clients are always either connected to a quorum node or not connected at all (CP, no A)
Re:Honest status reporting and AWS service status “truth”
by franciskim on Friday February 10, 2017 @10:42AM
(#13616094)
The point is, if a health check fails or if there is an outage on AZ 2 then the ELB should be scripted to route to AZ 1 only, as well as AZ 3 if it exists.
Re:Honest status reporting and AWS service status “truth”
by CoolGuySteve on Friday February 10, 2017 @10:17AM
(#13615925)
What purpose is served by being so condescending?
Re:Honest status reporting and AWS service status “truth”
by praneshp on Saturday February 11, 2017 @12:24AM
(#13621175)
He could've not said the noob comment in the end, but I hope his comment doesn't get flagged. The author could've read some AWS docs in the time he wrote this post.
Re:Honest status reporting and AWS service status “truth”
by franciskim on Friday February 10, 2017 @10:24AM
(#13615970)
It might sound condescending but I am merely stating facts and my opinon which froms the basis of my version of 'truth' as is the OP. I did not call anyone a liar at least.
Re:Honest status reporting and AWS service status “truth”
by garby on Friday February 10, 2017 @02:39PM
(#13618208)
In a perfect world, this makes sense. For us, we had an ElastiCache redis multi-AZ replication group whose primary was in the affected AZ. It refused to fail over, even though automatic failover was configured. Apparently there is no way to force this failover, even though people have been asking for such a feature for years. I'm curious what you would do in this situation, besides not using ElastiCache?