News for hackers. Stuff that matters.
Re:Major AWS Outage Happening by jpalomaki on Monday October 20, 2025 @05:13AM (#45641689)
When AWS is down, everybody knows it. People don’t really question your hosting choice. It’s the IBM of cloud era.
Re:Major AWS Outage Happening by JCM9 on Monday October 20, 2025 @06:22AM (#45642246)
Yes, but those days are numbered. For many years AWS was in a league of its own. Now they’ve fallen badly behind in a growing number of areas and are struggling to catch up.

There’s a ton of momentum associated with the prior dominance, but between the big misses on AI, a general slow pace of innovation on core services, and a steady stream of top leadership and engineers moving elsewhere they’re looking quite vulnerable.

Re:Major AWS Outage Happening by zjaffee on Monday October 20, 2025 @07:17AM (#45642629)
I couldn't agree more, there was clearly a big shift when Jassy became CEO of amazon as a whole and Charlie Bell left (which is also interesting because it's not like azure is magically better now).

The improvements to core services at AWS hasn't really happened at the same pace post covid as it did prior, but that could also have something to do with overall maturity of the ecosystem.

Although it's also largely the case that other cloud providers have also realized that it's hard for them to compete against the core competency of other companies, whereas they'd still be selling the infrastructure the above services are run on.

Re:Major AWS Outage Happening by cmiles8 on Monday October 20, 2025 @06:37AM (#45642339)
Looks like you’re being down voted for saying the quiet bit out loud. You’re not wrong though.
Re:Major AWS Outage Happening by cj on Monday October 20, 2025 @07:57AM (#45642903)
Or because people don’t agree with “days are numbered”.

As much as I might not like AWS, I think they’ll remain #1 for the foreseeable future. Despite the reasons the guy listed.

Re:Major AWS Outage Happening by JCM9 on Monday October 20, 2025 @08:07AM (#45642967)
Given recent earnings and depending on where things end up with AI it’s entirely plausible that by the end of the decade AWS is the #2 or #3 cloud provider.
Re:Major AWS Outage Happening by ApolloFortyNine on Monday October 20, 2025 @09:19AM (#45643576)
Can you throw out an example or two, because in my experience, AWS is the 'it just works' of the cloud world. There's a service for everything and it works how you'd expect.

I'm not sure what feature they're really missing, but my favorite is the way they handle AWS Fargate. The other cloud providers have similar offerings but I find Fargate to have almost no limitations when compared to the others.

Re:Major AWS Outage Happening by StilesCrisis on Monday October 20, 2025 @09:28AM (#45643657)
AWS' core advantage is price. No one cares if they are "behind on AI" or "the VP left." At the end of the day they want a cheap provider. Amazon knows how to deliver good-enough quality at discount prices.
Re:Major AWS Outage Happening by JCM9 on Monday October 20, 2025 @09:34AM (#45643717)
That story was true years ago but I don’t know that it rings true now. AWS is now often among the more expensive options, and with services that are struggling to compete on features and quality.
Re:Major AWS Outage Happening by onionisafruit on Monday October 20, 2025 @09:54AM (#45643972)
You’ve given a good description of IBM for most of the 80s through the 00s. For the first 20 years of that decline “nobody ever got fired for buying IBM” was still considered a truism. I wouldn’t be surprised if AWS pulls it off for as long as IBM did.
Re:Major AWS Outage Happening by pizlonator on Monday October 20, 2025 @10:19AM (#45644191)
I think that the worst thing that can happen to an org is to have that kind of status ("nobody ever got fired for buying our stuff" / "we're the only game in town").

It means no longer being hungry. Then you start making mistakes. You stop innovating. And then you slowly lose whatever kind of edge you had, but you don't realize that you're losing it until it's gone

Re:Major AWS Outage Happening by JCM9 on Monday October 20, 2025 @10:44AM (#45644501)
Unfortunately I think AWS is there now. When you talk to folks there they don’t have great answers to why their services are behind or not as innovative as other things out there. The answer is basically “you should choose AWS because we’re AWS.” It’s not good.
Re:Major AWS Outage Happening by sisve on Monday October 20, 2025 @05:20AM (#45641752)
That is 100% true. You cant be fired for picking AWS... But I doubt its the best choice for most people. Sad but true
Re:Major AWS Outage Happening by dijit on Monday October 20, 2025 @05:51AM (#45642002)
Schrodingers user;

Simultaneously too confused to be able to make their own UX choices, but smart enough to understand the backend of your infrastructure enough to know why it doesn't work and excuses you for it.

Re:Major AWS Outage Happening by 1dom on Monday October 20, 2025 @05:57AM (#45642054)
The morning national TV news (BBC) was interrupted with this as breaking news, and about how many services (specifically snapchat for some reason) are down because of problems with "Amazon's Web Services, reported on DownDetector"

I liked your point though!

Re:Major AWS Outage Happening by Macha on Monday October 20, 2025 @05:55AM (#45642043)
Well, at that level of user they just know "the internet is acting up this morning"
Re:Major AWS Outage Happening by dijit on Monday October 20, 2025 @06:00AM (#45642073)
I thought we didn't like when things were "too big to fail" (like the banks being bailed out because if we didn't the entire fabric of our economy would collapse; which emboldens them to take more risks and do it again).
Re:Major AWS Outage Happening by HelloNurse on Monday October 20, 2025 @06:55AM (#45642475)
A typical manager/customer understands just enough to ask their inferiors to make their f--- cloud platform work, why haven't you fixed it yet? I need it!

In technically sophisticated organizations, this disconnect simply floats to higher levels (e.g. CEO vs. CTO rather than middle manager vs. engineer).

Re:Major AWS Outage Happening by zejn on Monday October 20, 2025 @05:31AM (#45641842)
You can't be fired, but you burn through your runway quicker. No matter which option you choose, there is some exothermic oxidative process involved.
Re:Major AWS Outage Happening by rafaelmn on Monday October 20, 2025 @05:50AM (#45641999)
AWS is smart enough to throw you a few mill credits to get you started.
Re:Major AWS Outage Happening by dijit on Monday October 20, 2025 @06:04AM (#45642102)
MILL?!

I only got €100.000 bounded to a year, then a 20% discount for spend in the next year.

(I say "only" because that certainly would be a sweeter pill, €100.000 in "free" credits is enough to make you get hooked, because you can really feel the free-ness in the moment).

Re:Major AWS Outage Happening by echoangle on Monday October 20, 2025 @06:23AM (#45642257)
Mille is thousand in Latin so they might have meant a few thousand dollars.
Re:Major AWS Outage Happening by ExoticPearTree on Monday October 20, 2025 @07:15AM (#45642621)
Every one of the big hyperscalers has a big outage from time to time.

Unless you lose a significant amount of money per minute of downtime, there is no incentive to go multicloud.

And multicloud has its own issues.

In the end, you live with the fact that your service might be down a day or two per year.

Re:Major AWS Outage Happening by firesteelrain on Monday October 20, 2025 @07:46AM (#45642825)
When we looked at this our conclusion was not multi cloud but local resiliency with cloud augmentation. We still had our own small data center
Re:Major AWS Outage Happening by ta1243 on Monday October 20, 2025 @09:23AM (#45643611)
> In the end, you live with the fact that your service might be down a day or two per year.

This is hilarious. In the 90s we used to have services which ran on machines in cupboards which would go down because the cleaner would unplug them. Even then a day or two per year would be unacceptable.

Re:Major AWS Outage Happening by brazukadev on Monday October 20, 2025 @05:35AM (#45641873)
Usually, 2 founders creating a startup can't fire each other anyway so a bad decision can still be very bad for lots of people in this forum
Re:Major AWS Outage Happening by patshead on Monday October 20, 2025 @06:13AM (#45642180)
On the other side of that coin, I am excited to be up and running while everyone else is down!
Re:Major AWS Outage Happening by citrin_ru on Monday October 20, 2025 @06:46AM (#45642418)
On one hand it's allows to shift the blame but on other hand is shows a disadvantage of hyper centralization - if AWS is down too many important services are down at the same time which makes it worse. E. g. when AWS is down it's important to have communication/monitoring services UP so engineers can discuss / co-ordinate workarounds and have good visibility but Atlassian was (is) significantly degraded today too.
Re:Major AWS Outage Happening by anonymars on Monday October 20, 2025 @08:29AM (#45643145)
Facebook had a comically bad outage a few years ago wherein the internal sign-in, messaging, and even server keycard access went down

https://en.wikipedia.org/wiki/2021_Facebook_outage#Impact

Somewhat related tip of the day, don't host your status page as a subdomain off the main site. Ideally host it with a different provider entirely

Re:Major AWS Outage Happening by jamesbelchamber on Monday October 20, 2025 @05:41AM (#45641921)
To back up this point, currently BBC News have it as their most significant story, with "live" reporting: https://www.bbc.co.uk/news/live/c5y8k7k6v1rt

This is alongside "live" reporting on the Israel/Gaza conflict as well as news about Epstein and the Louvre heist.

This is mainstream news.

Re:Major AWS Outage Happening by addandsubtract on Monday October 20, 2025 @05:53AM (#45642025)
I like how their headline starts with Snapchat and Roblox being affected.
Re:Major AWS Outage Happening by Maxion on Monday October 20, 2025 @05:56AM (#45642046)
The journalist found out about it from their tween.
Re:Major AWS Outage Happening by kijin on Monday October 20, 2025 @06:37AM (#45642340)
They're the only apps English people are allowed to use, the rest of the internet is banned by Ofcom. /s
Re:Major AWS Outage Happening by throwdbaaway on Monday October 20, 2025 @10:07AM (#45644084)
Actually I am keen to know how Roblox got impacted. Following the terrible Halloween Outage in 2021, they posted 2 years ago about migrating to a cell based architecture in https://corp.roblox.com/newsroom/2023/12/making-robloxs-infr...

Perhaps some parts of the migration haven't been completed, or there is still a central database in us-east1

Re:Major AWS Outage Happening by abujazar on Monday October 20, 2025 @06:01AM (#45642085)
That depends on the service. Far from everyone is on their PC or smartphone all day, and even fewer care about these kinds of news.
Re:Major AWS Outage Happening by antihero on Monday October 20, 2025 @06:46AM (#45642413)
Amazon is up, what are they doing?
Re:Major AWS Outage Happening by petesergeant on Monday October 20, 2025 @05:36AM (#45641891)
100%. When AWS was down, we'd say "AWS is down!", and our customers would get it. Saying "Hetzner is down!" raises all sorts of questions your customers aren't interested in.
Re:Major AWS Outage Happening by sph on Monday October 20, 2025 @05:42AM (#45641940)
I've ran a production application off Hetzner for a client for almost a decade and I don't think I have had to tell them "Hetzner is down", ever, apart from planned maintenance windows.
[dead]
Re:Major AWS Outage Happening by Arch-TK on Monday October 20, 2025 @10:41AM (#45644444)
The point seems to be not that Hetzner will never have an outage, but rather that they have a track record of not having outages large enough for everyone to be affected.

Seems like large cloud providers, including AWS, are down quite regularly in comparison, and at such a scale that everything breaks for everyone involved.

Re:Major AWS Outage Happening by petesergeant on Monday October 20, 2025 @11:56AM (#45645371)
> The point seems to be not that Hetzner will never have an outage, but rather that they have a track record of not having outages large enough for everyone to be affected.

If I am affected, I want everyone to be affected, from a messaging perspective

Re:Major AWS Outage Happening by Arch-TK on Monday October 20, 2025 @04:41PM (#45649049)
Okay, that helps for the case when you are affected. But what about the case when you are not affected and everyone else is? Doesn't that seem like good PR?

Take the hit of being down once every 10 years compared to being up for the remaining 9 that others are down.

Re:Major AWS Outage Happening by antonis-gr on Monday October 20, 2025 @01:49PM (#45646889)
No provider is better than two providers.

Hosting on second- or even third-tier providers allows you to overprovision and have much better redundancy, provided your solution is architected from the ground up in a vendor agnostic way. Hetzner is dirt cheap, and there are countless cheap and reliable providers spread around the globe (Europe in my case) to host a fleet of stateless containers that never fail simultaneously.

Stateful services are much more difficult, but replication and failover is not rocket science. 30 minutes of downtime or 30 seconds of data loss rarely kill businesses. On the contrary, unrealistic RTOs and RPOs are, in my experience, more dangerous, either as increased complexity or as vendor lock-in.

Customers don't expect 100% availability and noone offers such SLAs. But for most businesses, 99.95% is perfecty acceplable, and it is not difficult to have less than 4h/year of downtime.

Re:Major AWS Outage Happening by throw-10-13 on Monday October 20, 2025 @06:14AM (#45642192)
most people dont even know aws exists
Re:Major AWS Outage Happening by cubix on Monday October 20, 2025 @06:26AM (#45642279)
Non-techies don’t. Here’s how CNN answered, what is AWS?

“Amazon Web Services (AWS) is Amazon’s internet based cloud service connecting businesses to people using their apps or online platforms.”

Uh.. yeah.

Re:Major AWS Outage Happening by ghc on Monday October 20, 2025 @06:52AM (#45642454)
Kudos to the Globe/AP for getting it right:

> An Amazon Web Services outage is causing major disruptions around the world. The service provides remote computing services to many governments, universities and companies, including The Boston Globe.

> On DownDetector, a website that tracks online outages, users reported issues with Snapchat, Roblox, Fortnite online broker Robinhood, the McDonald’s app and many other services.

Re:Major AWS Outage Happening by hansmayer on Monday October 20, 2025 @06:41AM (#45642374)
That's actually a fairly decent description for the non-tech crowd and I am going to adopt it, as my company is in the cloud native services space and I often have a problem explaining the technical and business model to my non-technical relatives and family - I get bogged down in trying to explain software defined hardware and similar concepts...
Re:Major AWS Outage Happening by rswail on Monday October 20, 2025 @07:48AM (#45642839)
It's the difference between connecting your home to the grid to get electricity vs having your own generator.

It's the same as having a computer room but in someone else's datacentre.

Re:Major AWS Outage Happening by hansmayer on Monday October 20, 2025 @08:09AM (#45642980)
This one's great too, thanks.
Re:Major AWS Outage Happening by cubix on Monday October 20, 2025 @07:06AM (#45642551)
I asked ChatGPT for a succinct definition, and I thought it was pretty good:

“Amazon Web Services (AWS) is a cloud computing platform that provides on-demand access to computing power, storage, databases, and other IT resources over the internet, allowing businesses to scale and pay only for what they use.”

Re:Major AWS Outage Happening by hansmayer on Monday October 20, 2025 @07:31AM (#45642720)
For us techies yes, but to the regular folks that is just as good as our usual technical gobbledy-gook - most people don´t differentiate between a database and a hard-drive.
Re:Major AWS Outage Happening by throwaway2037 on Monday October 20, 2025 @07:52AM (#45642862)
You make a good point.

This part:

    > access to computing power, storage, databases, and other IT resources
could be simplified to: access to computer servers

Most people who know little about computers can still imagine a giant mainframe they saw in a movie with a bunch of blinking lights. Not so different, visually, from a modern data center.

Re:Major AWS Outage Happening by herewulf on Monday October 20, 2025 @02:33PM (#45647436)
Ah, yes, servers. I have seen those at Chili's and TGI Fridays!
Re:Major AWS Outage Happening by stefan_ on Monday October 20, 2025 @05:31AM (#45641836)
And yet they still all activate their on call people (wait why do we have them if we are on the cloud?) to do .. nothing at all.
Re:Major AWS Outage Happening by nutjob2 on Monday October 20, 2025 @09:16AM (#45643543)
Which eventually leads to the headline "AWS down indefinitely, society collapses".