News for hackers. Stuff that matters.
Re:Software is breaking down at a systemic level by antonvs on Monday November 16, 2026 @03:10PM (#50522472)
> Which is great for corporate accountability

This is a common take, but it's most attractive for its cynicism, it doesn't fully represent the reality.

Cloud vendors are also great for allowing corporations to implement systems that would be prohibitive for them to implement, operate, and maintain as reliably on their own. Even big enterprises often struggle to implement everything they need, that a cloud provider can provide out of the box.

I worked at a multi-billion $ subsidiary of a global Fortune 500 company that tried, as part of its move off mainframes, to "go its own way", with their own hardware in Equinix data centers. The entire executive level of the IT team responsible for that effort - about five or six people - were eventually fired, along with much acrimony, because they couldn't pull it off. There were plenty of warning signs, but the final straw came when there was a major security breach, which was unacceptable because this company had federal customers and were subject to all sort of federal regulations, including CFIUS because the parent company was non-US. (They once had to rewrite an entire major system from scratch because of a breach of CFIUS regulations that made the government consider their code to be potentially compromised.)

That may be an unusual case, but the point is that if even large, well-funded, established companies can get a lot of benefit from cloud systems, that goes double or more for smaller companies, companies in less attractive industries, etc. etc.

(Pointing this out sometimes triggers people who maintain servers themselves, especially here on HN, but the point is those people don't work at the companies in question, and essentially don't scale - i.e. it's difficult to recruit enough of them and manage them and put together a durable system with enterprise-grade reliability that depends on having 10x sysadmins.)

And yes, "shit, EVERYTHING is down today" is a consequence of all this, but the alternative is generally much worse for individual companies.

Re:Software is breaking down at a systemic level by oceanplexian on Monday November 16, 2026 @03:27PM (#50522745)
IMHO it’s a skill issue. Nothing wrong with bare metal.

My friend runs an OSS project with 10s of thousands of users on a fairly realtime and latency sensitive application and it works great and has been very reliable. He does storage, compute, networking, all of it.

I run a FinTech startup on bare metal and do it for 1/10th the price of AWS (In two Geographic Regions). Reliability has been 4-5 9s over the last year. I’ve also worked for a few F500s. I’ve been the guy responsible for buying, racking, networking, and coding. I’ve also worked at AWS and am quite familiar with the pros and cons and nothing about my opinion has really changed, the cloud is a money printer that serves to make certain people extremely rich. Companies and individuals standing up their own hardware and learning how it works is a threat to their business model.

Re:Software is breaking down at a systemic level by bigstrat2003 on Monday November 16, 2026 @03:44PM (#50522990)
It is very much a skill issue. It's not some arcane art to keep servers online. We did so for years before the cloud was trendy.
Re:Software is breaking down at a systemic level by antonvs on Monday November 16, 2026 @04:16PM (#50523402)
This reminds me of an old boss of mine who wondered why we had to spend so much effort on securing our systems. I pointed out to him that we didn't used to be connected to the internet.

"Before the cloud was trendy", small to medium businesses didn't have millions of customers using their online systems.

Re:Software is breaking down at a systemic level by pixl97 on Monday November 16, 2026 @05:39PM (#50524489)
How many servers? How many disks? How many users? Average throughput? Average IOPs? Average latency? How did the software running on them scale?

I mean I kept servers online for years, but they didn't see anything like the traffic and security threats that show up now.

Re:Software is breaking down at a systemic level by wpollock on Monday November 16, 2026 @04:04PM (#50523255)
> Companies and individuals standing up their own hardware and learning how it works is a threat to their [cloud/big tech] business model.

This point never occurred to me but it explains so much. In addition to the points made in this thread, I have seen a dismantling of tech education. For example, I created the two-year degree program for Florida in Linux system administration 20+ years ago. I later learned the program's requirements were gutted by a committee; the took a Windows administration degree document and s/Windows|Microsoft/Linux/g. The new requirements included adding users using Linux active directory and other absurdities. Programming degree knowledge requirements were also dumbed down.

All this because educated tech workers are a threat to someone's bottom line.

Re:Software is breaking down at a systemic level by antonvs on Monday November 16, 2026 @04:14PM (#50523380)
This is exactly what I was referring to in my parenthetical.

You're thinking of this from the perspective of your own personal expertise, not from a business perspective. The problem is that you don't scale. There are millions of businesses using cloud services. You're not working for any of them. Do you want to?

And are there millions of people with your experience and skills? Doubtful. (If there were, you'd be a lot less valuable.) And a company of any significant size can't rely on one person to operate their systems, so you need a team, and you need to manage that team, and the managers have to be good as well.

Also, 10s of thousands of users is tiny in the modern world. Instagram scaled to 30 million users on AWS with something like 13 employees, before it was acquired by Facebook. It would have been much different if they'd had to do that on their own hardware. They're an outlier, but many business are able to use the cloud to scale to levels that would require a massive internal effort otherwise, especially if they have to meet compliance requirements, integrate with other enterprises, etc.

> Companies and individuals standing up their own hardware and learning how it works is a threat to their business model.

They don't care much about this "threat", because executives look at the situation and choose cloud because it makes business sense.

Re:Software is breaking down at a systemic level by 10111001 on Monday November 16, 2026 @04:28PM (#50523549)
> I worked at a multi-billion $ subsidiary of a global Fortune 500 company that tried, as part of its move off mainframes, to "go its own way", with their own hardware in Equinix data centers. The entire executive level of the IT team responsible for that effort - about five or six people - were eventually fired, along with much acrimony, because they couldn't pull it off.

> ...

> And yes, "shit, EVERYTHING is down today" is a consequence of all this, but the alternative is generally much worse for individual companies.

IIRC, AWS and cloud infrastructure didn't get big until the mid-2010s. Fortune 500 companies (and everyone else) were able to "go their own way" with their own hardware before that, they had to.

If this is hard to do now, I'd guess that's not because it's impossible, but because there's been a combination of skill/capability loss (similar to what's been seeing in manufacturing) and places like AWS sucking up much of the remaining talent.

Re:Software is breaking down at a systemic level by pixl97 on Monday November 16, 2026 @05:43PM (#50524535)
So how much internal server hardware did they have then versus they rent from AWS now?

The biggest problem most businesses started running into with server rooms was supplying enough power and cooling. You're starting to talk about running out of power coming in and places for generators where businesses had their server rooms. Instead of new buildings they clouded it out.