SLAs are nice PR finger pointing tools. No one cares about the pennies you get back. We broke our SLA because Google broke their SLA is a good enough excuse for most of your clients most of the time. Nobody ever got fired for buying IBM still applies.
Also, once you're massive sized, at least AWS (though I'm sure GCP/Azure too) seems more than happy to negotiate below their listed pricing, especially for hardware.
Security and lock-in are definitely real concerns when considering cloud providers. But let's not pretend cloud providers aren't competitive on price and convenience.
https://aws.amazon.com/solutions/case-studies/capital-one/
https://www.computerworld.com/article/3145622/cloud-computin...
And they are even investing in cloud companies:
https://www.geekwire.com/2017/trying-snowflake-computings-ne...
If you have a simple website and need a key-value store, with a few clicks you can configure a DynamoDB instance -- 50 reads+writes/second will cost around $30/month. Most companies would be hard pressed to set up any open source KV store with 24x7 availability, cross-datacenter replication + backups as well as keeping it patched for less than $360/year.
For a small shop without much (or any) operational support, AWS can save money, complexity and effort.
For a larger company with significant load, then it may be cheaper to host the services they need themselves, but the scalability of Amazon services means that's purely a financial decision, not a technical decision -- by the time you start to outgrow the capacity of amazon hosted services, you're generally past the point where it's worth it to host your own.
And while bare metal may be cheaper, when you own bare metal, you own it 24x7 - you can't scale your infrastructure 3X to handle daytime peak load, or scale it 10X for a day to handle end of quarter processing then scale it back down the next day and stop paying for all of that hardware.
Of course, cloud computing is not a panacea and not a perfect fit for all use cases but there are many use cases where it makes sense and can reduce cost and complexity and make it easier to address scalability and redundancy.
Small shops, in my experience, have more time and labor available than money.
> by the time you start to outgrow the capacity of amazon hosted services, you're generally past the point where it's worth it to host your own.
That's one of my points. There is no such point. The bigger you become, the more money you'll save by doing it yourself. Read the Dropbox migration story:
https://blogs.dropbox.com/tech/2016/03/magic-pocket-infrastr...
Also, if this were true, then why aren't Google, FB, Amazon, Microsoft, Alibaba ... hosting their infrastructure on cloud providers (even their own) ? I assure you at such scales, money becomes a very strong argument. And yet all are choosing to not do this, as far as I'm aware.
The bigger your scale, the stronger the argument becomes to not use cloud.
> And while bare metal may be cheaper, when you own bare metal, you own it 24x7 - you can't scale your infrastructure 3X to handle daytime peak load, or scale it 10X for a day to handle end of quarter processing then scale it back down the next day and stop paying for all of that hardware.
Can I make a slightly sarcastic remark ? This cloud scaling is only useful if your credit card can handle 50x the charges. (there was an article to the tune of "cloud: when will we get to the first $500 page refresh ?", but I can't find it right now).
But perhaps better put, since it's cheaper to own and manage 10x the bare metal capacity than it is to cloud rent 1x that capacity, for any non-trivial amount of capacity, this argument does not mean anything. Add to that that 10x the bare metal capacity has lots of advantages, from technical debt ones, like lower lock-in, to financial ones, you actually own the capital.
I don't understand the argument you're making very much at all. It's not self-consistent. Half of what you say can only apply to super-small companies, and half could only apply to the very very large. And when you're in either argument, you say you agree with my objections to the other part. That not doing cloud is cheaper for very large customers, and that cloud doesn't matter for the very small.
There is a usecase for cloud, but it would never support the cloud providers: if you have a load that suddenly requires 1000x capacity and then doesn't require any capacity for at least a month, then cloud makes sense. So, you're a startup oil driller that needs to crunch through geological survey accoustics, sure, by all means. But if people used cloud only in such cases where it actually makes sense then the companies doing cloud would not be economical ...
They are... they are literally the cloud(s) and their biggest customer. In fact, they are big enough to offer you their ops and expertise for a small fee over baremetal. Many cloud consumers are literally using up the overhead existing in these businesses' hardware that would otherwise be sitting around.
It can be done cheaper, sure but not without giving up opportunity time and work you may just not want to deal with. I certainly am over having to manage supplier relationships or having to wake someone I don't know or find difficult to converse with to bounce a router or kick a generator.
When a developer costs the company $100+/hour, it's hard to justify paying him/her to manage a database when you can pay AWS $50/month to do it.... and AWS will almost always do it better than a developer will do in his/her spare time.
The bigger your scale, the stronger the argument becomes to not use cloud.
Sure, very large companies may find it more cost effective to own their own hardware and datacenters, but there's a huge number of comapnies where self-hosting makes no sense. I know someone at a company that pays nearly $1M/month to AWS -- the company has about 50 developers and 2 ops staff to manage the entire compute infrastructure, their server count varies throughout the day depending on customer demand from around 1000 overnight to 8000 servers during peak daytime usage. Their peak lasts from 6am - 6pm, so most servers would be unused for 12 hours a day. They've got about a petabyte of storage in AWS S3.
But, since you're focused on pricing for bare metal vs AWS, let's look at some pricing that's loosely based on a company I used to work for. (this company took data from customers, ran monthly processing and returned aggregated data to customers,so nearly all bandwidth was inbound)
A Dell R530 with a 20 Thread CPU, 4x16GB RAM and 4TB SSD disk (RAID-1 so 2TB usable) is around $8500, or around $275/month for a 3 year lease. You can rent 1U in a reliable coloc for $200 (including network port + basic firewall services), so you're looking at $575/month.
This is roughly equivalent to 4 m4.xlarge's ($0.086/hour each at 3 year reserved pricing) and 2TB SSD EBS disk ($200/month) or around $450/month. Add in a TB of outbound data for $100, so that's $550/month.
Sounds pretty comparable... oh, but you want redundancy, if your machine (or data center) goes up in flames, you don't want to lose your service, so add in another hardware server + fees, so you're paying over $1000/month.
Depending on your need for redundancy, with Amazon you may be fine with an ASG with health check that restarts your server if it fails. Or you can spread your servers across data centers. Or you keep cold spares in another AZ or region that you launch once a day to sync disks so you're only paying for 5 minutes/day of usage)
So that covers base load. So now, at the end of the month your customers have been sending you data, and they expect you to process it and send aggregated reports back to them within 3 days of the end of the month. You don't have enough spare CPU/memory on your existing servers (even if you use your spare server) to do this month-end processing with existing hardware, so you spin up 4 i3.8xlarge's (32 core, 244GB CPU, 8TB local SSD) at $2.50/hour for 32 hours, or $320 for all 4.
Each of those is bigger than the R530's you're using, but let's say pricing is the same, so you're paying another $1000/month to lease servers you're only using 2 days a month.
And now your service grows and you want to expand capacity. If you own the servers, you need to buy new ones and pay someone to rack and configure them and migrate your applications. While with AWS you just do a quick stop/start and suddenly you're running on a bigger server.
This cloud scaling is only useful if your credit card can handle 50x the charges
If you can't pay for your infrastructure it doesn't matter whether you're on cloud servers or not.
How about this one ?
https://www.hetzner.com/dedicated-rootserver/ex41s
That's, including network bandwidth, 40 euros/month. The commit is one month, not three years. And redundancy is a problem, fair enough. How about we take two in every continent, and still comfortably beat you on price ?
You might say that the cpu is not equivalent, but I'll discuss that below. Everything else is obviously equivalent or better.
At this point you've got WAY more of everything, including reliability, for a significantly lower price. Everything. Network bandwidth, cpu capacity, disk, memory, everything.
And this is metal, not virtualized performance. So aside from many tasks performing better (anything that isn't pure compute, anything that needs to use the network, disk, ... whatever), you're also way safer, you actually get to use the memory ...
4x m4.xlarge will give you, in total 16 "vcpu" on a 2.4 GHz Intel Xeon® E5-2676 v3 (most likely), plus 64 gigs of ram. The i7 runs at 4Ghz, with significantly less cache (takes 3 of them have more cache than 1 Xeon). However, since this isn't virtualized it's going to matter a LOT less.
You see you are trying to compare 2/3 of a single xeon cpu in a quad-xeon server virtualized against 100% of a dual xeon server. Surprise ! The 100% dual xeon is more expensive. In reality that R530 is equivalent to 12 m4.xlarges.
So apples to apples, however, non-cloud is absurdly much cheaper.
And I'm being polite here, not pointing out that 100G of internet bandwidth is nothing, and just how much that Hetzner server includes, or your example hosted R530 (will definitely come with, in the worst case possible, 40T, and if you want better prices than that, feel free to contact me)
> > This cloud scaling is only useful if your credit card can handle 50x the charges
> If you can't pay for your infrastructure it doesn't matter whether you're on cloud servers or not.
True, but every big company got big by producing more value for less money. Not hosting on cloud is going to make the less money part a lot easier.
> And dedicated servers are linux servers. You can hire engineers, I believe, that have used those.
Hiring a single engineer to do this is more expensive than using a cloud service...
Minor nit: banks are increasingly using cloud computing where they legally can, and that's becoming a lot easier now that regulators are using the cloud as well.
The bigger problem for banks with cloud is cross-border data transfer. Will Luxembourg or Monaco or $country allow banks there to host their computers in a cloud in Frankfurt or Dublin or Amsterdam? Sometimes they do, sometimes they don't, so you always have to have a backup plan.
How many organisations need a database to scale like that ? Maybe 1000 worldwide, and at least 900 of them are forbidden by law to run them on clouds (e.g. banks).
Also, cloud is essentially outsourcing server management. If you're of a size that needs these sorts of databases, you need a big IT department, cloud or no cloud. At that point, cloud is just vastly more expensive without any monetary advantage.
And of course, if you use any of these, the lock in is ridiculous. Also known as "they have you by the b....", and if one thing is damned sure the result will not be saving money, complexity or effort. Or savings of any kind whatsoever.
> on-demand and flexible instance types which allow you to try something without committing
And ever more management systems that let management "control spending", "control access", ... and so on, designed to prevent that. The problem with the old system was management and processes getting in the way of experimenting, and the only advantage cloud has is that it doesn't have decent support for such processes yet.
Every vendor is racing to build them in, and it's getting worse week by week. It won't be long before experimenting is impossible in cloud just like it is in owned datacenter and dedicated setups.
The problem with experiments is management in every company I've ever consulted for, and cloud doesn't change a thing, aside from, at the moment, management incompetence getting in the way of their usual sabotage. That will stop once current engineers that know cloud start getting a few promos and is already happening.
> spot instances, autoscaling groups, access to job scheduling like kubernetes. At scale (thousands of nodes) technologies like this are extremely important
There is no shortage of system supporting this sort of load on dedicated machines, servers, ...
> redundant and reliable service. It also gives you someone to complain too and blame (they provide slas)
Have you read those slas ? They'll return 10% or so of what you normally pay (not in cash of course, in vouchers) if their service is out for 33% of the time or so. That's not an sla, that's just laughable. If they are out for 5% of the total time, I'd be so pissed I'd start a chargeback.
As for redundancy and reliability, there is no shortage of vendors with similar reliability track records, and it is well documented how to make server setups that provide reliability.
> powerful management tooling and APIs that are well documented and widely understood (you can hire an engineer that has used AWS)
And dedicated servers are linux servers. You can hire engineers, I believe, that have used those.
> security: audit trails, integrated single sign on, private networks, vpns, role based access keys
Yep, these controls are part of what's preventing that experimenting advantage that currently exists. In reality, all of this relies on well designed policies at the customer side, and I've yet to see that done properly for more than a single team in any company.
All of these are of course critically dependent on Google's network, tapped by the NSA as documented in the famous leaked "SSL inserted and removed here" slide, and for numerous privacy breaches, Amazon, famous for "somehow" finding out about how the businesses hosted on their cloud work and taking their customers away (apparently more than 100 court cases against Amazon currently going on), or Microsoft, famous for so many things, including pushing through centralization in Skype for the admitted reason of gaining the ability to spy on their customers. I'm sure their ethics in the cloud hosting department are much better.
And please don't even mention those "encrypted storage" assurances. They're not even worth being called bullshit. If I get to write the code that you use to encrypt/decrypt, I can obviously trivially break any key you use. If you don't believe me, I'll give you a webbrowser to download, and I assure you it encrypts all your passwords, then just log into your web banking a few times and see what happens (note: webbrowsers inserting "extra" transactions when doing webbanking are a common thing to find in security work).
So secure ... yeah right.
Sure, it can work. It won't, of course.
> I could keep going.
Yeah you could mention that cloud's real advantage is that engineers believe that if they get a web-based non-multiplayer version of minesweeper implemented on kubernetes, they'll get a $200k+ GOOG/FB job. Not true, of course, but nobody wants to tell em that. In fact, implementing a linked list in C on a DOS 1.0 C compiler will help them a LOT more.