Aside from huge customers like Dropbox, which most likely get deep discounts on AWS, I don't see who else could get a better deal out of AWS (or any similar cloud provider) than they would get by directly renting dedicated servers, even considering the much-hyped scalability factor (which most customers probably don't ever end up needing anyway, because...let's face it, there's just so much attention going around on the net, which means there can be just a very limited number of things that "go viral", while there are many, many more services competing for said attention out there). That's at least true for the European market. AFAIK, the US hosting market is a bit different and generally more expensive, so AWS might have a better price point with regard to the competition there.
Well, how would you handle massive traffic spikes? Through a combination of vertical and horizontal scaling? Through having excess capacity? Except that I would probably want to start with something fast and inexpensive to begin with.
If you wait until the spike hits before you spin up your VM you're still too late.
I don't follow your line of reasoning, you seem to suggest that to build a scalable service you yourself would prefer to use servers with necessarily poor price/performance?
Or are you saying that it's not possible to use dedicated machines to build a scalable service? Or that one should only use VMs, with their inefficiency and resource contention? How do you reason about disk seek performance? What happens when the spike hits, and another AWS customer on the box starts stealing CPU?
Actually, traffic spikes were the reason we moved off AWS. A single dedicated machine at Hetzner gives 10x the headroom at a fraction of the cost. That buys you time and capacity when you need it.
precisely. this is the other elephant in the AWS room. the only way to survive a spike without service degradation while vm spin up on that platform is through lambdas/s3 served pages/api gateway - but even lambdas lag behind traffic.
but then you need to build your whole architecture for it
anyway I'm running on AWS right now, but for other advantages and services, not for its scalability/price performance.
The thing is though, the scaling is nice but most folks just want the auto-recovery. You stick your app over 3 zones, you have autoscaling and you can run with a couple of Ops savy devs and largely forget about it.
You no longer need to pay for that dedicated sysadmin who knows how to manage a datacentre when have a small number of technical staff. The extra hosting bills are less than hiring that other person.
we do have a custom AMI that just fetch and build the latest snapshot release when we need auto-scaling or auto-recovery, but our real problem is that we currently depend on sticky session, so users accumulated on the initial instances get sucky performances. (and yes we are currently working on fixing it, we cannot outright serialize sessions on dynamo because, reasons)
It's shown that many people want all of this outsourced for them and will pay a premium to do so. I always find it a bit silly that every time an AWS service is announced it is compared to some bare minimum other provider that is out there that is cheaper. Of course it is going to be cheaper, but that really is irrelevant.
In 2008 we started a browsergame that attracted more than 200.000 players. Until 2009 we had to rent big fat servers that could cope with the load and costed over 4000 € per month. Since then hardware got so fast that our PHP software with 500k line of code and 200GB stuff in databases could run on 3-4 dedicated servers that we could rent from almost every german provider for around 300-500 € per month. Since 2014 we have everything on virtual servers hosted by Hosteurope because we wanted managed hosting like AWS and it was even cheaper than running our old dedicated machines. At that time we looked at AWS and we were totally shocked by the prices (we were also shocked how difficult it is to understand the AWS universe)! We're paying less than a tenth for much more performance than we need than we would pay for even the cheapest, 1 year reservation stuff from AWS. Even if our playerbase would triple overnight, our virtual machines would easily cope with that. And upgrading them needs a two clicks and a reboot. Also: we see it as a plus that we have not to deal with all the Amazon stuff, because they have so much APIs, names and complexity in their system. Nobody wants to learn all this and nobody wants to deal with multi-location and replication just because amazon has unreliable servers. German providers seems to have datacenters and servers that don't crash every once in awhile. I'm flabbergasted by how often I read that AWS has broken disks, crashed servers, crashed datacenters, network problems and so on. Since 2008 we had two or three problems in the datacenters at our different providers, with a total downtime of 8 hours. That would be just a little less than 99.99% uptime over all the years... I really wanted to try the new shiny thing that is called AWS but no matter how I looked at it, it is just a very very costly solution for something with built in unreliability.
The company website can take a beating, but onboarding new customers takes weeks if not months. Plenty of time to plan and scale.
Someone from AWS proactively called me up out of the blue the other day to ask for input and to interview me about what I need, and offered to quote. I received a phone call or two and two emails and after mentioning the exact specs and price I get from Hetzner, and being genuinely interested in perhaps getting a competitive quote, I waited and received no reply for some time and then the following:
"I'm sorry for my late response. I’ve been pretty busy these days…"
"I had a look at what your technical specifications below and I'd like to understand a bit more what type of business you're doing."
"One of AWS's main strengths lies in the scalability of our platform."
"How much is the % of usage of your dedicated server? What happens if it reaches the maximum usage? At AWS, you can start with smaller instances and use auto-scaling to scale up or down automatically according to your traffic."
"Is scalability a challenge for you?"
There was no quote attached. :)
Hetzner's price/performance is an elephant in the room it seems.