AWS Multiple Services Down in us-east-1

Re:AWS Multiple Services Down in us-east-1 by wwdmaxwell on Monday October 20, 2025 @07:55AM (#45642885)

I think Amazon uses an internal platform called Dynamo as a KV store, it’s different than DynamoDB, so im thinking the outage could be either a dns routing issue or some kind of node deployment problem.

Both of which seem to prop up in post mortems for these widespread outages.

[ Parent | on HN ]

Re:AWS Multiple Services Down in us-east-1 by oofbey on Monday October 20, 2025 @11:28AM (#45645049)

They said the root cause was DNS for dynamoDB. inside AWS relying on dynamoDB is highly encouraged so it’s not surprising that a failure there would cascade broadly. The fact that EC2 instance launching is effected is surprising. Loops in the service dependency graph are known to be a bad idea.

[ Parent | on HN ]

Re:AWS Multiple Services Down in us-east-1 by etc-hosts on Monday October 20, 2025 @10:37PM (#45651854)

It's not a direct dependency. Route 53 is humming along... DynamoDB decided to edit its DNS records that are propagated by Route 53... they were bogus, but Route 53 happily propagated the toxic change to the rest of the universe.

DynamoDB is not going to set up its own DNS service or its own Route 53.

Maybe DynamoDB should have had tooling that tested DNS edits before sending it to Route 53, or Route53 should have tooling to validate changes before accepting them. I'm sure smart people at AWS are yelling at each other about it right now.

[ Parent | on HN ]

Re:AWS Multiple Services Down in us-east-1 by plandis on Tuesday October 21, 2025 @01:49PM (#45659044)

Dynamo is AFAIK, not used by core AWS services.

[ Parent | on HN ]