News for hackers. Stuff that matters.
Re:Summary of the Amazon DynamoDB Service Disruption in US-E... by ramraj07 on Thursday October 23, 2025 @10:03PM (#45689933)
As I was reading through that list, I kept feeling, "why do I feel this is not universally true?"

Then I realized: the internet; the power-grid (at least in most developed countries); there are things that don't actually fail catastrophically, even though they are extremely complex, and not always built by efficient organizations. Whats the retort to this argument?

Re:Summary of the Amazon DynamoDB Service Disruption in US-E... by singron on Thursday October 23, 2025 @10:41PM (#45690156)
They do fail catastrophically. E.g. https://en.wikipedia.org/wiki/Northeast_blackout_of_2003

I think you could argue AWS is more complex than the electrical grid, but even if it's not, the grid has had several decades to iron out kinks and AWS hasn't. AWS also adds a ton of completely new services each year in addition to adding more capacity. E.g. I bet these DNS Enactors have become more numerous and their plans became much larger than when they were first developed, which has greatly increased the odds of experiencing this issue.

Re:Summary of the Amazon DynamoDB Service Disruption in US-E... by ramraj07 on Friday October 24, 2025 @07:45PM (#45700219)
Okay I concede that the power grid was a poor example but clearly the internet is not. No one pointed out a counter for teh internet
Re:Summary of the Amazon DynamoDB Service Disruption in US-E... by singron on Friday October 24, 2025 @08:04PM (#45700319)
Some of the biggest failures have been BGP leaks/hijacks. E.g. https://www.ripe.net/about-us/news/youtube-hijacking-a-ripe-...

This has gotten significantly better in recent years, but it used to be possible and common for a single misbehaving AS to cause global issues.

Re:Summary of the Amazon DynamoDB Service Disruption in US-E... by jb1991 on Thursday October 23, 2025 @10:44PM (#45690173)
The power grid is a huge risk in several major western nations.
Re:Summary of the Amazon DynamoDB Service Disruption in US-E... by habinero on Thursday October 23, 2025 @10:18PM (#45690028)
The power grid absolutely can fail catastrophically and is a lot more fragile than people think.

Texas nearly ran into this during their blackout a few years ago -- their grid got within a few minutes of complete failure that would have required a black start which IIRC has never been done.

Grady has a good explanation and the writeup is interesting reading too.

https://youtu.be/08mwXICY4JM?si=Lmg_9UoDjQszRnMw

https://youtu.be/uOSnQM1Zu4w?si=-v6-Li7PhGHN64LB

Re:Summary of the Amazon DynamoDB Service Disruption in US-E... by baq on Friday October 24, 2025 @02:14AM (#45691394)
Re:Summary of the Amazon DynamoDB Service Disruption in US-E... by figassis on Friday October 24, 2025 @03:34AM (#45691926)
The grid fails catastrophically. It happened this year in Portugal, spain and nearby countries? Still, think of the grid as more like DNS. It is immense, but the concept is simple and well understood. You can quickly identify where the fault is (even if not the actual root cause), and can also quickly address it (even if bringing it back up in sync takes time and is not trivial). Current cloud infra is different in that each implementation is unique, services are unique, knowledge is not universal. There are no books about AWS's infra fundamentals or how to manage AWS's cloud.
Re:Summary of the Amazon DynamoDB Service Disruption in US-E... by grumbelbart2 on Friday October 24, 2025 @06:10AM (#45692933)
Also, aviation is great example of how we can manage failures in complex systems and how we can track and fix more and rarer failures over time.