The cloud was probably always more expensive if you only considered the cost of computers. But it was about so much more than that. Mostly, it was about creating a hostile environment for the BOFHs who were creating a hostile environment for everyone else.
They weren't seen as so unprofitable they had to be eliminated, but unprofitable enough that competition could triangulate their price vs pain.
If you are paying significant cash for network, then what ever you are doing you need a CDN of some sort (I assume most people are web here.)
VPS bandwidth is not unlimited, and it is a single point of failure.
The way I read this is that the operating costs are higher in the cloud, but presumably dwarfed by recouped opportunity costs. This makes sense to me, given my limited experience working in large companies where every interaction with IT involved a 2-6 week turnaround time. Need a VM? Fill out a bunch of paperwork and then wait a month. We missed a lot of opportunities that way.
The true opportunity cost in large corporations is from, IMHO, been the general attitude of "we can't do foo new thing because that's [not best practice, not (barely) supported by some other large corporation, too cheap, too big of a change, etc]."
The ability to create extremely flexible workloads in minutes means nothing when security has to approve sneezes and containers are only something you'd find in a fridge.
Its not so much the availability of physical servers (although that might be an issue) it was the features, and the time it took to port new bits and bobs.
A classic example is databases. We had a puppet script that provided a HA-mysql cluster. However, it was very fragile, never really worked and I'm mostly sure the backups never actually took place.
It would take me (a devop who was tasked with doing this sort of thing) the best part of 3 days to setup and verify. The whole thing collapsed when the DBA that made it left.
RDS is a one click operation. yes its more expensive to run long term, but the saving on staff time was enormous. I will never go back to inhouse rolled puppet, unless it was proven to be outstanding.
What was the opex before cloud?
But software licensing costs play a massive factor in the overall opex.
A cracking business opportunity: a cheap "personal cloud" for SMEs that just works? An extension would be an associated "public cloud", allowing customers to seamlessly move between their personal and the public cloud to cover short term scaling issues whilst they buy more private infrastructure.
What is FC?
There was a full rack switch, which must have been easily 400 + ports.
I joined just at the point where they were moving from VMware to AWS.
It was never a cost saving exercise. It was a way to completely change the culture of the IT department. As they were one of the very first news websites, they had at the time ~18 years of cruft to deal with.
The drive to the cloud was about flexibility, and if we are honest, shaking the staffing tree to get rid of the ossified staff.
They went from three data centres (mixture of SUN and Intel blades all backed by FC) to pure AWS/heroku. The running costs went up significantly, the opex was close to £3mil in AWS bills alone, all to put text on a web page.
It will continue to rise because it offers flexibility, and as each product now has its own account, standards are difficult to enforce. This means lots of snowflake installs of X that are now critical to Y.
The cloud is more expensive for large companies, for most workloads. For SMEs its the total opposite.