News for hackers. Stuff that matters.
Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by hipadev23 on Thursday November 16, 2023 @04:04PM (#38295512)
They were paying on-demand ec2 prices and reserved instances alone would save them ~35%, savings plan even more which would apply to egress and storage costs too. Anyway, they're still saving a lot more (~55%), but it's not nearly as egregious of a difference.
Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by Karrot_Kream on Thursday November 16, 2023 @04:17PM (#38295671)
After that 35% savings, they ended up saving about a US mid level engineer's salary, sans benefits. Hope the time needed for the migration was worth it.
Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by alberth on Thursday November 16, 2023 @04:48PM (#38296033)
I'm sure the are also getting better performance as well.

Not sure how to factor that $ into the equation.

Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by flkenosad on Thursday November 16, 2023 @05:30PM (#38296555)
Also, I'd imagine most companies can fill unused compute with long-running batch jobs so you're getting way more bang for your buck. It's really egregious what these clouds are charging.
Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by darkwater on Thursday November 16, 2023 @05:18PM (#38296415)
To get real savings with a complex enough project you will need one or more FTE salaries just to stay on top of AWS spending optimizations
Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by baz00 on Thursday November 16, 2023 @05:34PM (#38296607)
Plus...

2x FTEs to manage the AWS support tickets

3x FTE to understand the differences between the AWS bundled products and open source stuff which you can't get close enough to the config for so that you can actually use it as intended.

3x Security folk to work out how to manage the tangle of multiple accounts, networks, WAF and compliance overheads

3x FTEs to write HCL and YAML to support the cloud.

2x Solution architects to try and rebuild everything cloud native and get stuck in some technicality inside step functions for 9 months and achieve nothing.

1x extra manager to sit in meetings with AWS once a week and bitch about the crap support, the broken OSS bundled stuff and work out weird network issues.

1x cloud janitor to clean up all the dirt left around the cluster burning cash.

---

Footnote: Was this to free us or enslave us?

Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by hotpotamus on Thursday November 16, 2023 @05:37PM (#38296635)
> Footnote: Was this to free us or enslave us?

I assume whichever provides more margin to Jeff Bezos.

Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by gymbeaux on Thursday November 16, 2023 @05:46PM (#38296735)
Our experience hasn’t been THAT bad but we did waste a lot of time in weekly meetings with AWS “solutions architects” who knew next to nothing about AWS aside from a shallow, salesman-like understanding. They make around $150k too, by the way. I tried to apply to be one, but AWS wants someone with more sales experience and they don’t really care about my AWS certs
Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by baz00 on Thursday November 16, 2023 @05:54PM (#38296820)
As an AWS Solution Architect (independent untethered to Bezos) I resent that comment. I know slightly more than next to nothing about AWS and I can Google something and come up with something convincing and sell it to you in a couple of minutes!
Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by gymbeaux on Friday November 17, 2023 @08:22PM (#38313617)
How do I make $150k (or more) having high-level conversations about AWS with senior software engineers? Seriously. I’m sure it’s not an “easy” job, but fuck if I make less actually writing the software (median SWE salary is something like $140k in the US- depends on who you ask but it’s not the $250k+ that Levels.fyi would lead you to believe).
Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by scarface_74 on Thursday November 16, 2023 @07:27PM (#38297639)
I can guarantee an SA working for AWS makes more than $150k. A returning L4 intern makes that much (former AWS Professional Services employee)

And no one cares about AWS certifications. They are proof of nothing and disregarded by anyone with a modicum of a clue.

I’m speaking as someone who once had nine active certifications and I believe I still have six active ones. I only got them as a guided learning path. I knew going in they were meaningless.

Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by icedchai on Thursday November 16, 2023 @07:55PM (#38297863)
This cracked me up. I was "asked" to get some AWS certs since I joined a company that was an AWS Partner. We have a new VP that is forcing other people to get them. Big waste of time for all practical purposes.
Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by scarface_74 on Thursday November 16, 2023 @08:16PM (#38298007)
So to be clearer.

Having an AWS certification is not a requirement or even that important to get a job at AWS in the Professional Services department. Depending on your job position you are required to have certain certifications once you get there.

I now work for a partner and you are required to have a certain number of “certified individuals” to maintain partnership status. But even then, certifications never came up in my three interviews after getting “Amazoned” a couple of months ago.

But then again, after having AWS ProServe on my resume and having been a major contributor to a popular open source project in my niche, door opened for my automatically.

Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by icedchai on Thursday November 16, 2023 @10:16PM (#38299033)
I didn't mind getting the certifications to "help out" the company, I just find it such a racket: paying for courses, buying books, $200 tests. Some people take months preparing for that stuff! I didn't buy any courses and only spent a few days preparing, but others spend tons of time and money on it.

And based on my own personal interactions with other "certified" individuals, it doesn't actually mean anything.

Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by gymbeaux on Friday November 17, 2023 @08:19PM (#38313577)
I’m sure everyone here is aware of the colloquial hate that certs get outside of IT (“A+”, etc.) , even I.

What I don’t know is why AWS would rather pay a salesman $150k (or more… I looked up salaries a few months ago, but either way…) to sell the wrong things to customers, rather than have a software engineer who has actually used these products, sell the right thing to customers. I should hope that all AWS Solutions Architects need to pass the cloud fundamentals exam before interacting with customers, but maybe not?

Deming is rolling in his grave.

Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by scarface_74 on Sunday November 19, 2023 @09:34AM (#38332973)
There are different types of SAs at AWS. There are the generalist SAs who I never worked with and the specialist SAs who have deep experience in a specific area of the industry - not just AWS.

And even they aren’t to be confused with “consultants”. SAs are free to customers and give general guidance and are not allowed to give the customers any code.

Consultants are full time employees at AWS who get paid by the customer to do hands on keyboard work. But even we couldn’t work in production environments. We did initial work and taught the customer how to maintain and enhance the work.

If you don’t know the cloud fundamentals, learning enough to pass a few multiple choice questions.

As an anecdote, I passed the first one - the Solution Architect Associate - before I ever opened the AWS console.

Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by gymbeaux on Monday November 20, 2023 @02:50PM (#38353506)
Thanks for the detailed info.

I’m aware the bar is low when it comes to the entry-level certs, and that’s why I’d hope AWS SAs (the free kind) have to pass one or two.

Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by ezekiel68 on Thursday November 16, 2023 @06:50PM (#38297333)
Where I work (hint: very large satellite radio company) this is very much a thing.
Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by makeitdouble on Thursday November 16, 2023 @05:18PM (#38296416)
Getting a bare metal stack has interesting side effects on how they can plan future projects.

One that's not immediately obvious is to keep on staff experienced infra engineers that bring their expertise for designing future projects.

Another is the option to tackle project in ways that would be to costly if they were still on AWS (e.g. ML training, stuff with long and heavy CPU load).

Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by meowface on Thursday November 16, 2023 @05:35PM (#38296611)
A possible middle-ground option is to use a cheaper cloud provider like Digital Ocean. You don't need dedicated infrastructure engineers and you still get a lot of the same benefits as AWS, including some API compatibility (Digital Ocean's S3-alike, and many others', support S3's API).

Perhaps there are some good reasons to not choose such a provider once you reach a certain scale, but they now have their own versions of a lot of different AWS services, and they're more than sufficient for my own relatively small scale.

Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by gymbeaux on Thursday November 16, 2023 @05:44PM (#38296708)
That’s the niche DigitalOcean is trying to carve out. I’ve always loved and preferred their UI/UX to that of AWS or Azure. No experience with the CLI but I would guess it’s not any worse than AWS CLI.
Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by skor on Thursday November 16, 2023 @06:05PM (#38296930)
How would you compare it to google cloud run? thanks
Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by flkenosad on Thursday November 16, 2023 @05:23PM (#38296464)
Yep and hardware is only getting cheaper. Better to just buy more drives/chips when you need them.
Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by jbverschoor on Thursday November 16, 2023 @06:35PM (#38297206)
M4.xlarge (m4.xlarge, 4cpu, 16gb, no storage) is about $100 per month. This cpu is 7 years old(slow! and power hungry) and has 36 threads. This means it runs 18 of these instances.

The total revenue so far for one cpu is 100x18x12x7 = $150k If used as a spot instance it’s 144/month, so about 200k

A standard 14th i7 gen has 28 threads, so it can run 12 of these instances (max 192mem). This CPU will cost you $500. Memory is cheap, so for about 1k you’re all set, and have a machine that’s way faster and cheaper.

Basically, buy a bunch of NUCs and you’re saving yourself around $1500 per month per NUC. It pays itself back in 1 month

Cloud hosting is —insane—

Not even touching memory ballooning for mostly idle applications.

Lastly, don’t give me reliability s an argument. These were all ephemeral instances that have no storage, so you’ll have to pay for that slow non-nvme storage platform.

Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by mr_toad on Thursday November 16, 2023 @07:32PM (#38297671)
If you can do it for some much less than Amazon (and all the other cloud vendors), then why don’t you create your own cloud and undercut them?
Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by peteradio on Thursday November 16, 2023 @07:55PM (#38297855)
Hosting for the world is different than hosting for yourself.
Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by makeitdouble on Thursday November 16, 2023 @11:19PM (#38299518)
You wouldn't ask people who cook for themselves why they don't open a restaurant to undercut the competition.
Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by efitz on Thursday November 16, 2023 @05:29PM (#38296544)
I was thinking the same thing. If the migration took more than one man-year then they lost money.

Also what happens at hardware end-of-life?

Also what happens if they encounter an explosive growth or burst usage event?

And did their current staffing include enough headcount to maintain the physical machines or did they have to hire for that?

Etc etc. Cloud is not cheap but if you are honest about TCO then the savings likely are WAY less than they imply in the article.

Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by flkenosad on Thursday November 16, 2023 @05:38PM (#38296650)
> If the migration took more than one man-year then they lost money.

Your math is incorrect. The savings are per year. The job gets done once.

> Also what happens at hardware end-of-life?

You buy more hardware. A drive should last a few years on average at least.

> Also what happens if they encounter an explosive growth or burst usage event?

Short term, clouds are always available to handle extra compute. It's not a bad idea to use a cloud load-balancing system anyway to handle spam or caching.

But also, you can buy hardware from amazon and get it the next day with Prime.

> And did their current staffing include enough headcount to maintain the physical machines or did they have to hire for that?

I'm sure any team capable of building complex software at scale is capable of running a few servers on prem. I'm sure there's more than a few programmers on most teams that have homelabs they muck around with.

> Etc etc.

I'd love to hear more arguments.

Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by m00x on Friday November 17, 2023 @12:28AM (#38299940)
The job is never done once. Not in hardware.
Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by sgarland on Thursday November 16, 2023 @07:17PM (#38297560)
> Also what happens if they encounter an explosive growth or burst usage event?

TFA states that they maintain their AWS account, and can spin up additional compute in ~10 minutes.

Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by awslol on Thursday November 16, 2023 @05:30PM (#38296550)
They also saved the salaries of the team whose job was doing nothing but chasing misplaced spaces in yaml configuration files. Cloud infrastructure doesn't just appear out of thin air. You have to hire people to describe what you want to do. And with the complexity mess we're in today it's not at all clear which takes more effort.
Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by gymbeaux on Thursday November 16, 2023 @05:41PM (#38296684)
Exactly. Last job I worked at there was always an issue with the YAML… and as a “mere” software engineer, I had to wait for offshore DevOps to fix, but that’s another issue.
Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by scarface_74 on Thursday November 16, 2023 @07:25PM (#38297626)
If you are waiting on a “DevOps department”, it isn’t a DevOps…it’s operations
Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by gymbeaux on Monday November 20, 2023 @02:53PM (#38353558)
My company called them the DevOps Team
Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by icedchai on Thursday November 16, 2023 @07:51PM (#38297825)
Did you try and fix it yourself? Was that not allowed?
Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by gymbeaux on Monday November 20, 2023 @02:52PM (#38353539)
Yeah that was not allowed. We started off managing our own DevOps in our own AWS region even, separate from the rest of the company. Eventually the DevOps team mandated we move to the same region as everyone else, and then soon after that there was enough conflict with my (offshore) team and DevOps (onshore) that DevOps demanded and got complete control over our DevOps, though not infrastructure.
Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by quickthrower2 on Thursday November 16, 2023 @05:41PM (#38296680)
100% this. Cloud is a hard slog too. A different slog though. We spend a lot of time chasing Azure deprecations. They are closing down a type of MySQL instance for example for one which is more “modern” but from the end user point of view it is still a MySQL server!
Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by icedchai on Thursday November 16, 2023 @05:42PM (#38296693)
To manage a large fleet of physical servers, you need similar ops skills. You're not going to configure all those systems by hand, are you?
Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by postalrat on Thursday November 16, 2023 @06:32PM (#38297165)
They spent $150,000 on physical servers. Probably 1 or 2 racks. Not much of a 'fleet'.
Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by ketzo on Thursday November 16, 2023 @07:18PM (#38297570)
I mean, “fleet” semantics aside, surely $150,000 of servers is enough for at least one full-time person to be maintaining them. The point is that there are absolutely maintenance and ops costs associated with these servers.
Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by dijit on Thursday November 16, 2023 @07:25PM (#38297622)
There's maintenance cost to everything that runs a userland.

What we're missing is tracking what time is spent managing hardware and firmware, (or even network config, if we're being generous) and how much time is being spent on OS config.

From personal experience (as a sysadmin before it was entirely unsexy as a term) the overwhelming majority of my ops work was done in userland on the machine, maybe something like 96-97% of my tasks were nothing to do with hardware at all.

Since I got rebranded as SRE, the tools and the pay sure did get a lot better in the time, but the job is largely similar and ultimately running in VMs does make deployment faster, but once deployed I find the maintenance burden to be the same (or perhaps a little more) as things seem to become deprecated or require changes from our cloud vendor a bit more often.

Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by awslol on Thursday November 16, 2023 @05:59PM (#38296869)
Depends on the size of the fleet.

If you're using less than a dozen servers manual configuration is simpler. Depending on what you're doing that could mean serving a hundred million customers. Which is plenty for most business.

Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by icedchai on Thursday November 16, 2023 @06:09PM (#38296975)
A dozen servers would be pushing it. It's not the size of the fleet, it's the consistency and repeatability of configuration and deployment. I assume there are other, non-production servers: various dev environments, test/QA. How do you ensure every environment is built to spec without some level of automation? It's the old "pets" vs "cattle" argument.

I've worked at companies with their own data centers and manual configuration. Every system was a pet.

Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by notnmeyer on Thursday November 16, 2023 @06:06PM (#38296951)
sorry, what? theyre running on k8s and using helm... so there's still piles of yaml. its wild to conflate migrating to bare metal with eliminating yaml-centric configuration.
Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by PartiallyTyped on Thursday November 16, 2023 @11:57PM (#38299750)
CDK exists. Haven’t had to use yaml in ages and I refuse to.
Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by dilyevsky on Thursday November 16, 2023 @05:30PM (#38296557)
I broke the rules and read the article first:

> In the context of AWS, the expenses associated with employing AWS administrators often exceed those of Linux on-premises server administrators. This represents an additional cost-saving benefit when shifting to bare metal. With today’s servers being both efficient and reliable, the need for “management” has significantly decreased.

I also never seen an eng org where substantial part of it didn’t do useless projects that never amount to anything

Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by rewmie on Thursday November 16, 2023 @05:46PM (#38296727)
I get the point that they tried to make, but this comparison between "AWS administrators" and "Linux on-premises server administrators" is beyond apple-and-oranges and is actually completely meaningless.

A team does not use AWS because it provides compute. AWS, even when using barebonea EC2 instances, actually means on-demand provisioning of computational resources with the help of infrastructure-as-code services. A random developer logs into his AWS console, clicks a few buttons, and he's already running a fully instrumented service with logging and metrics a click away. He can click another button and delete/shut down everything. He can click on a button again and deploy the same application in multiple continents with static files provided through a global CDN, deployed with a dedicated pipeline. He clicks on another button again and everything is shut down again.

How do you pull that off with "Linux on-premises server administrators"? You don't.

At most, you can get your Linux server administrators to manage their hardware with something like OpenStack, but they would be playing the role of the AWS engineers that your "AWS administrators" don't even know exist. However, anyone who works with AWS only works on the abstraction layers above that which a "Linux on premises administrator" works on.

Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by baz00 on Thursday November 16, 2023 @05:52PM (#38296789)
This is the voice of someone who has never actually ended up with a big AWS estate.

You don't click to start and stop. You start with someone negotiating credits and reserved instance costs with AWS. Then you have to keep up with spending commitments. Sometimes clicking stop will cost you more than leaving shit running.

It gets to the point where $50k a month is indistinguishable from the noise floor of spending.

Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by rewmie on Thursday November 16, 2023 @06:34PM (#38297197)
> This is the voice of someone who has never actually ended up with a big AWS estate.

I worked on a web application that provided by a FANG-like global corporation that is a household name and used by millions of users every day, and which can and did made the news rounds if it experiences issues. It is a high-availability multi-region deployment spread about a dozen independent AWS accounts and managed around the clock by multiple teams.

Please tell me more how I "never actually ended up with a big AWS estate."

I love how people like you try to shoot down arguments with appeals to authority when you are this clueless about the topic and are this oblivious regarding everyone else's experience.

Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by baz00 on Thursday November 16, 2023 @07:05PM (#38297451)
Hey me too.
Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by dijit on Thursday November 16, 2023 @07:20PM (#38297593)
Hrm. I have worked for a global corporation that you have almost certainly heard of. Though it's not super sexy.

The parent you're replying to resonates with me. A lot of politics about how you spend and how you commit, it's almost as bad as the commitment terms for bare-metal providers (3,6,12,24month commits). Except the base-load is more expensive.

It depends a lot on your load, but for my workloads (which, is fragile dumb but very vertical compute with a wide geographic dispersion), the cost is so high that a few dozen thousand has been missed numerous times, despite having in-house "fin-ops" folks casting their gaze upon our spend.

Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by ygjb on Thursday November 16, 2023 @05:53PM (#38296814)
Yeah, that's part of it. The other part is that you can move stuff that is working, and working well, into on-prem (or colo) if it is designed well and portable. If everything is running in containers, and orchestration is already configured, and you aren't using AWS or cloud provider specific features, portability is not super painful (modulo the complexity of your app, and the volume of data you need to migrate). Clearly this team did the assessment, and the savings they achieved by moving to on-prem was worthwhile.

That doesn't preclude continuing to use AWS and other cloud service as a click-ops driven platform for experimentation, and requiring that anything that is targeting production to refactored to run in the bare-metal environment. At least two shops I worked at previously have used that as a recurring model (one focusing on AWS, the other on GCP) for stuff that was in prototyping or development.

Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by rewmie on Thursday November 16, 2023 @06:26PM (#38297119)
> Yeah, that's part of it. The other part is that you can move stuff that is working, and working well, into on-prem (or colo) if it is designed well and portable.

That's part of the apples-and-oranges problem I mentioned.

It's perfectly fine if a company decides to save up massive amounts of cash by running stable core services on-premises instead of paying small fortunes to a cloud provider for the equivalent service.

Except that that's not the value proposition of a cloud provider.

A team managing on premises hardware barely covers a fraction of the value or flexibility provided by a cloud service. That team of Linux sysadmins does not nor will it ever provide the level of flexibility nor cover the range of services that a single person with access to a AWS/GCP/Azure account provides. It's like claiming that buying your own screwdriver is far better than renting a whole workshop. Sure, you have a point if all you plan on doing is tightening that screw. Except you don't pay for a workshop to tighten up screws, and instead you use it to iterate over designs for your screws before you even know how much load it's expected to take.

Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by sgarland on Thursday November 16, 2023 @07:06PM (#38297465)
Counterpoint: most shops do not need most of the bespoke cloud services they're using. If you actually do, you should know (or have someone on staff who knows) how to operate it, which negates most of the point of renting it from a cloud provider.

If you _actually need_ Kafka, for example – not just any messaging system – then your scale is such that you better know how to monitor it, tune it, and fix it when it breaks. If you can do that, then what's the difference from running it yourself? Build images with Packer, manage configs with Ansible or Puppet.

Cloud lets you iterate a lot faster because you don't have to know how any of this stuff works, but that ends up biting you once you do need to know.

Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by lo_stronzo on Friday November 17, 2023 @10:03AM (#38304505)
> Counterpoint: most shops do not need most of the bespoke cloud services they're using. If you actually do, you should know (or have someone on staff who knows) how to operate it, which negates most of the point of renting it from a cloud provider.

Well said! At $LASTJOB, new management/leadership had blinders on [0][1] and were surrounded by sycophants & "sales engineers". They didn't listen to the staff that actually held the technical/empirical expertise, and still decided to go all in on cloud. Promises were made and not delivered, lots of downtime that affected _all areas of the organization_ [2] which could have been avoided (even post migration), etc. Long story short, money & time were wasted on cloud endeavors for $STACKS that didn't need to be in the cloud to start, and weren't designed to be cloud-based. The best part is that none of the management/leadership/sycophants/"sales engineers" had any shame at all for the decisions that were made.

Don't get me wrong, cloud does serve a purpose and serves that purpose well. But, a lot of people willfully ignore the simple fact that cloud providers are still staffed with on-prem infrastructure run by teams of staff/administrators/engineers.

[0] Indoctrinated by buzz words [1] We need to compete at "global scale" [2] Higher education

Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by scarface_74 on Thursday November 16, 2023 @07:23PM (#38297611)
> Yeah, that's part of it. The other part is that you can move stuff that is working, and working well, into on-prem (or colo) if it is designed well and portable. If everything is running in containers

Anyone who says that hasn’t done it at scale.

“Infrastructure has weight”. Dependencies always creep in and any large scale migration involves regression testing, security, dealing with the PMO, compliance, dealing with outside vendors who may have white listed certain IP addresses, training, vendor negotiations, data migrations etc.

And then even though you use MySQL for instance, someone somewhere decided to do a “load data into S3” AWS MySQL extension and now they are going to have to write an ETL job. Someone else decided to store and serve static assets web assets to S3.

Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by ygjb on Friday November 17, 2023 @12:45PM (#38307110)
I mean, aside from my current role in Amazon, my last several roles have been at Mozilla, OpenDNS/Cisco, and Fastly; each of those used a combination of cloud, colo and on-prem services, depending on use cases. All of them worked at scale.

I specifically said "if it is designed well", and that phrase does alot of heavy lifting in that sentence. It's not easy, and you don't always put your A-team on a project when the B or C team can get the job done.

The article outlines a case where a business saw a solid justification for moving to bare metal, and saved approximately 1-3 SDE (depending on market) salary in doing so.

That amount of money can be hugely meaningful in a bootstrapped business (for example, for one of the businesses my partner owns, saving that much money over COVID shut-downs meant keeping the business afloat rather than shuttering the business permanently).

Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by scarface_74 on Friday November 17, 2023 @12:51PM (#38307204)
I didn’t mean to imply that you have worked at scale, just that doing a migration at scale is never easy even if you try to stay “cloud agnostic”.

Source: former AWS Professional Services employee . I just “left” two months ago. I now work for a smaller shop. I mostly specialize in “application modernization”. But I have been involved in hairy migration projects.

Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by icedchai on Thursday November 16, 2023 @07:46PM (#38297780)
Most folks aren't focused on portability. Almost every custom built AWS app I've seen is using AWS-specific managed services, coded to S3, SQS, DynamoDB, etc. It's very convenient and productive to use those services. If you're just hosting VMs on EC2, what's the point?
Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by dilyevsky on Thursday November 16, 2023 @05:51PM (#38296778)
> A random developer logs into his AWS console, clicks a few buttons, and he's already running a fully instrumented service with logging and metrics a click away...

This only works that way for very small spend orgs that haven’t implemented soc 2 or the like. If that’s what you’re doing then probably should stay away from datacenter, sure

Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by rewmie on Thursday November 16, 2023 @06:05PM (#38296933)
> This only works that way for very small spend orgs that (...)

No, not really. That's how basically all services deployed to AWS work once you get the relevant CloudFormation/CDK bits lined up. I've worked on applications designed with high-availability in mind, which included multi-region deployments, which I could deploy as sandboxed applications on personal AWS accounts in a matter of a couple of minutes.

What exactly are you doing horribly wrong to think that architecting services the right way is something that only "small spend orgs" would know how to do?

Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by dilyevsky on Thursday November 16, 2023 @06:22PM (#38297087)
Your original comment gives an impression that you like AWS bc anyone can click-ops themselves a stack so that's why you got all these clickops comments.

How is an army of "devops" implementing your CF/CDK stack any different from an army of (lower paid) sysadmins running proxmox/openstack/k8s/etc on your hw?

Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by rewmie on Friday November 17, 2023 @04:48AM (#38301451)
> Your original comment gives an impression that you like AWS (...)

My comment is really not about AWS. It's about the apples-to-oranges comparison between the job of "Linux on-premises server administrator" and value-added of managing on-premises servers, and the role of "AWS administrator". Someone needs to be completely clueless to the realities of both job roles to assume they deliver the same value. They don't.

Someone with access to any of the cloud provider services on the market is able to whip out and scale up whole web applications with far more flexibility and speed than any conceivable on-premises setup managed with the same budget. This is not up for debate.

> How is an army of "devops" implementing your CF/CDK stack any different from an army of (lower paid) sysadmins running proxmox/openstack/k8s/etc on your hw?

Think about it for a second. With the exact same budget, how do you pull off a multi-region deployment with an on-premises setup managed by your on-premises linux admins? And even if your goal is providing a single deployment, how flexible are you to put up this scheme to test a prototype and afterwards shut down the service?

Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by dilyevsky on Friday November 17, 2023 @06:16PM (#38312016)
> Someone with access to any of the cloud provider services on the market is able to whip out and scale up whole web applications with far more flexibility and speed than any conceivable on-premises setup managed with the same budget.

Bullshit. I've seen people spin wheels for months/years deploying their cloud native jank and you should read the article - it's not nearly the same budget.

> Think about it for a second. With the exact same budget, how do you pull off a multi-region deployment with an on-premises setup managed by your on-premises linux admins?

You do realize things like site interconnect exist right? And it likely will be cheaper than paying your cloud inter-region transfer fees. You're going to be testing multi-regional prototype? please

Look there's a very simple reason why folks have been chasing public clouds and it has nothing to do their marketing spiel of elastic compute, increased velocity, etc. That reason is simple - teams get control of their spend without having to ask anyone for permission (like the old-school infra team).

Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by spamizbad on Thursday November 16, 2023 @05:52PM (#38296786)
Going to be honest: If your AWS spend is well over 6 figures and you’re still click-ops-ing most things you’re:

1) not as reliable as you think you are 2) probably wasting gobs of money somewhere

Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by scarface_74 on Thursday November 16, 2023 @07:17PM (#38297557)
From the parents posters comments, the developers could very well be putting together quick proofs of concepts.

I’ve set up an “RnD” account where developers can go wild and click ops away. I also set up a separate “development” account where they can test thier IAC manually and then commit it and it gets tested through a CI/CD pipeline. Then after that it goes through the standard pull request/review process.

Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by notnmeyer on Thursday November 16, 2023 @06:02PM (#38296910)
hrm, did you read the article?

> Our choice was to run a Microk8s cluster in a colocation facility

they go on to describe they use helm as well. there's no reason to assume that "a a fully instrumented service with logging and metrics" still isnt a click and keypress away.

your points dont make a whole lot of sense in the context of what they actually migrated too.

Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by awslol on Thursday November 16, 2023 @05:52PM (#38296787)
You just log into the server...

Not everything is warehouse scale. You can serve tens of millions of customers from a single machine.

Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by anonzzzies on Friday November 17, 2023 @12:17AM (#38299874)
Not on HN. Where everyone uses Rust and yet needs a billion node web scale mesh edge blah minimally otherwise you are doing it wrong. Rather waste 100k per month on aws because ‘if the clients come downtime is expensive’ than just run a 5$ vps and actually make a profit while there are not many clients. It’s the VC rotten mindset. Good for us anyway; we don’t need to make 10b$ to make the investors happy. Freedom.
Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by jbverschoor on Thursday November 16, 2023 @06:04PM (#38296928)
Emm… run proxmox?
Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by freefrog334433 on Thursday November 16, 2023 @07:24PM (#38297615)
I worked for a large telco, where we hosted all our servers. Each server ran multiple services bare-metal - no virtualization, and it was easy to rollout new services, without installing new servers. I missed the level of control over network elements and servers, the flexibility, and ability to debug by taking network traces anywhere in the network in my next job using AWS.
Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by ricardobeat on Friday November 17, 2023 @03:15AM (#38300880)
> A random developer logs into his AWS console, clicks a few buttons, and he's already running a fully instrumented service with logging and metrics a click away

In a dream. In the real world of medium-to-large enterprise, a developer opens a ticket or uses some custom-built tool to bootstrap a new service, after writing a design doc and maybe going through a security review. They wait for the necessary approvals while they prepare the internal observability tools, and find out that there is an ongoing migration and their stack is not fully supported yet. In the meantime, he needs permissions to edit the Terraform files to update routing rules and actually send traffic to their service. At no point he does, or ever will, have direct access to the AWS console. The tools mentioned are the full-time job of dozens of other engineers (and PMs, EMs and managers). This process takes days to weeks to complete.

Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by oxfordmale on Thursday November 16, 2023 @05:54PM (#38296819)
That is having your cake and eat it. AWS administrators don't do the same job as on prem administrators.
Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by mvdtnz on Thursday November 16, 2023 @06:12PM (#38296999)
Well yeah, that's why they're more expensive.
Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by dabeeeenster on Thursday November 16, 2023 @06:00PM (#38296889)
> "I also never seen an eng org where substantial part of it didn’t do useless projects that never amount to anything"

Bootstrapped companies generally don't do this btw. This is a symptom of venture backed companies.

Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by dilyevsky on Thursday November 16, 2023 @06:06PM (#38296941)
Don't do what? go cloud? Sure they do, they just generally don't get cloud credits so they can get hooked.
Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by dabeeeenster on Thursday November 16, 2023 @06:08PM (#38296966)
Apologies - I edited my comment to clarify context.

> I also never seen an eng org where substantial part of it didn’t do useless projects that never amount to anything

Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by fragmede on Thursday November 16, 2023 @08:23PM (#38298063)
there's nothing about being bootstrapped vs venture backed that lets everyone know, a priori, whether a given project will be successful or not. something like 80% of startups fail within the first two years.
Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by AlotOfReading on Thursday November 16, 2023 @10:01PM (#38298900)
Absolutely not my experience. I used to work for a Japanese company that was almost entirely self funded. They wouldn't even go to the bank and get business loans.

Your description applies to a substantial number of business units in that company. They also had a "research institute" whose best result in the last decade was an inaccurate linear regression (not a euphemism for ML).

Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by dabeeeenster on Saturday November 18, 2023 @05:49AM (#38317959)
I think if youre at the size of "business units" youre not "bootstrapping" any more
Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by touristtam on Friday November 17, 2023 @12:22AM (#38299907)
You've never had friend and colleagues working at big (local and international) established companies sharing their experience of projects being canned, and not just repurposed?
Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by MuffinFlavored on Thursday November 16, 2023 @07:20PM (#38297584)
> I also never seen an eng org where substantial part of it didn’t do useless projects that never amount to anything

Name one of business (tech or non tech) where this is ok/accepted and competitive in capitalism.

How long will we keep making these inflated salaries while being known for being wasteful, globally speaking?

Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by peteradio on Thursday November 16, 2023 @07:52PM (#38297826)
What is that jockey doing on the horse? We only pay him to race!
Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by dilyevsky on Thursday November 16, 2023 @09:15PM (#38298474)
It’s not like other industries (or academia) are any better. Please.
Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by dheera on Thursday November 16, 2023 @05:33PM (#38296591)
They probably need to now hire 24/7 security to watch the bare metal if they're serious about it, so not sure about that engineer
Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by dilyevsky on Thursday November 16, 2023 @05:36PM (#38296617)
onsite security is offered by the colo provider. You can also pay for locked cabinets with cameras and anti-tampering or even completely caged off depending on your security requirements
Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by baz00 on Thursday November 16, 2023 @05:37PM (#38296629)
If we saved 35% that could hire 20 FTEs.

Not that we'd need them as we wouldn't have to write as much HCL.

Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by stcroixx on Thursday November 16, 2023 @06:38PM (#38297229)
Freedom from vendor lock in is hard to put a value on, but for me it’s definitely worth a mid level engineers salary in any context.
Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by scarface_74 on Thursday November 16, 2023 @07:31PM (#38297661)
Yes, as long as you ignore the other literally 100 or so SaaS products that the average enterprise uses. You are always locked in to your infrastructure at any decent scale
Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by avereveard on Thursday November 16, 2023 @06:40PM (#38297242)
And the servers are brand new, so maintenance is not factor in yet.
Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by jcelerier on Friday November 17, 2023 @06:29AM (#38302081)
outside of the US you could likely pay for two mid or three juniors for this though, e.g. in France a junior engineer in an average city would likely be around 46-48k$USD for the total employer cost and France is already expensive compared to a lot of other countries with talented engineers
Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by threeseed on Thursday November 16, 2023 @04:29PM (#38295812)
Also being an uptime site surprised they didn't use the m7g instance type.

Would've saved another ~30% for minimal difference in performance.

For me this doesn't look like a sensible move especially since with AWS EKS you have a managed, highly-available, multi-AZ control plane.

Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by hipadev23 on Thursday November 16, 2023 @05:17PM (#38296396)
I’d be so excited to run my company’s observability platform on a single self-managed rack.
Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by RhodesianHunter on Thursday November 16, 2023 @04:10PM (#38295585)
Right. Now what's the developer man-hour cost of the move?

Unless their product is pretty static and not seeing much development, they're probably in the negative.

Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by zer00eyz on Thursday November 16, 2023 @04:30PM (#38295831)
It's not a very good question: they still have aws compatibility as their fail over/backup (should be live but that's another matter...)

What's capex vs opex now? Thats 150k of depreciable assets, probably ones that will be available for use long after all the current staff depart.

Everyone forgets what WhatsApp did with few engineers and less hardware, there's probably more than enough room for them to grow, and they have space to increase capacity.

The cloud has a place, but candidly so does a Datacenter and ownership.

Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by RhodesianHunter on Tuesday November 21, 2023 @02:27PM (#38368680)
> they still have aws compatibility as their fail over/backup

Now you're maintaining two tiers. That's more work, not less.

Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by manvillej on Thursday November 16, 2023 @04:16PM (#38295653)
when we don't optimize for cloud and look at it from this angle and squint, it looks like we're saving money!
Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by potatopatch on Thursday November 16, 2023 @06:11PM (#38296984)
> Right. Now what's the developer man-hour cost of the move?

I think the real question is what's the cost to buy an equal number of training hours so you can pretend your resources are that competent.

Imagine a military that never fought, never did significant exercises and probably doesn't even have cleaning exercises any more on half its inventory.. That's basically how I view a company that had organic IT growth over a few years and hasn't done a major transition in anyone's recent memory.

Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by cj on Thursday November 16, 2023 @04:36PM (#38295905)
> savings plan even more which would apply to egress and storage

Wait, is this accurate?

If so I need to sign our company up for a savings plan... now. We use RI's but I thought savings plan only applied to instance cost and not bandwidth (and definitely not S3)

Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by tommek4077 on Thursday November 16, 2023 @05:24PM (#38296478)
You got it right. They do not include traffic or S3.
Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by throw555chip on Thursday November 16, 2023 @04:21PM (#38295709)
Bandwidth would need to be compared and considered between EC2 and what they were able to negotiate for bare metal co-location.
Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by bauruine on Thursday November 16, 2023 @04:55PM (#38296127)
Bandwidth is about 2 orders of magnitude less on non-cloud even without any negotiation or commitment. How much do you have to commit for e.g. Cloudfront to pay 2 orders of magnitude less than their list price of 0.02 per GB?
Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by ttt3ts on Thursday November 16, 2023 @07:36PM (#38297698)
To give you ballpark I host metal servers at a few different data centers. A gig up is a few hundred dollars a month.

Let's say you're really pushing the connection and your p95 is 900megabit up. That is $200 at colo vs ~$8200 for amazon.

Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by cypress66 on Thursday November 16, 2023 @04:10PM (#38295588)
Going from AWS to something like hetzner would be most of the way there probably.
Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by hipadev23 on Thursday November 16, 2023 @04:11PM (#38295597)
Hetzner in particular is a disaster waiting to happen, but yes I agree with the sentiment. OVH doesn't arbitrarily shut off your servers or close your account without warning.
Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by rgrieselhuber on Thursday November 16, 2023 @04:16PM (#38295652)
We’ve been on both Hetzner and OVH for years and have never had this happen.

The move does cost money, once. Then the savings over years add up to a lot. We made this change more than 10 years ago and it was one of the best decisions we ever made.

Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by nonsens3 on Thursday November 16, 2023 @04:23PM (#38295736)
Hetzner randomly shuts down one of my servers every 2-3 months.
Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by codenesium on Thursday November 16, 2023 @04:42PM (#38295971)
Nice of them to test your failover for you.
Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by rgrieselhuber on Thursday November 16, 2023 @04:43PM (#38295981)
Yeah you do have to have redundancy built in, but we don't get random shutdowns.
Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by razemio on Thursday November 16, 2023 @05:00PM (#38296188)
I am sorry what? I have been with Hetzner over 10 years hosting multiple servers without issue. There has to my knowledge never been a shutdown without notice on bare metal servers and it does not happen often. Like once every 2 years.
Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by ptico on Thursday November 16, 2023 @05:29PM (#38296533)
Hetzner suspended the account of a non-profit org I voluntarily supported, without explaining the reason or giving us possibility to take our data out. The issue was resolved only after bringing it to the public space. Even there they tried to pretend we are not actually their customers first
Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by ezekiel68 on Thursday November 16, 2023 @06:53PM (#38297362)
Right -- regrettable. And also a very rare anecdote.
Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by scns on Thursday November 16, 2023 @05:13PM (#38296341)
Username checks out, well trolled. Snark fully intended.
Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by riku_iki on Thursday November 16, 2023 @05:27PM (#38296517)
I had the same issue, sent them ticket, they swapped server, and worked fine since then.
Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by dvfjsdhgfv on Thursday November 16, 2023 @05:49PM (#38296760)
I've been using Hetzner for years and what happens every 3-4 years is that a disk dies. So I inform them, they usually replace it within an hour and I rebuild the array, that's all.

Recently I've been moving most projects to Hetzner Cloud, it's a pleasure to work with and pleasantly inexpensive. It's a pity they didn't start it 10 years earlier.

Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by forty on Thursday November 16, 2023 @04:25PM (#38295765)
I think OVH might let your server burn and the backup which was stored next to it (of course) with it ;)
Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by rgrieselhuber on Thursday November 16, 2023 @04:44PM (#38295990)
Definitely don't keep all your data in one region only. For object storage, I prefer Backblaze unless you need high throughput.
Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by FpUser on Thursday November 16, 2023 @04:28PM (#38295808)
Using both Hetzner and OVH for years and not a single problem be it technical or administrative. Does not men it never happens but this is just my experience
Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by dvfjsdhgfv on Thursday November 16, 2023 @05:53PM (#38296803)
> Hetzner in particular is a disaster waiting to happen

Why would you spread FUD? They have several datacenters in different locations, and even if they were as incompetent as OVH (they are not)[0], the destruction of one datacenter doesn't mean you will lose data stored in the remaining ones.

[0] I bet OVH is also way smarter than they were before the fire.

Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by quectophoton on Thursday November 16, 2023 @06:08PM (#38296962)
With Hetzner presumably they mean them randomly closing accounts as sibling comments mention, or marking your account as suspicious and requiring you to send them a scan of your passport, and even then there are some comments[1] saying that they were still denied.

[1]: https://news.ycombinator.com/item?id=37108072

Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by dvfjsdhgfv on Friday November 17, 2023 @03:40AM (#38300998)
I don't believe in "randomly closing accounts". As for sending a scan of my passport/ID I did this when I opened the account with them which was back in 2010 or so.

During that time, one of my servers was hacked once (I was stupid enough to start digging Monero on the same system I had some other services installed) and another time one of my users had a weak password and his account was sending spam. In both cases they notified me and gave me the time to fix the problem. I also appreciate human contact and quick replies.

Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by ActorNightly on Thursday November 16, 2023 @05:11PM (#38296311)
Also, EKS (i.e a managed service) is also more expensive then renting EC2s and doing everything yourself, which is not that hard.
Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by threeseed on Thursday November 16, 2023 @05:36PM (#38296623)
EKS's control plane consists of decent EC2 instances, ELB, ENIs distributed across multiple availability zones.

You're not saving anything doing it yourself.

And you've just given yourself the massive inconvenience of running a HA Kubernetes control plane.

Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by pojzon on Thursday November 16, 2023 @05:26PM (#38296499)
Is 150$ really that much when you are paying hundreds of thousends for nodes ?
Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by aranelsurion on Thursday November 16, 2023 @05:14PM (#38296347)
If that's the case, probably just going for Spot machines would save them more than that move.
Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by ezekiel68 on Thursday November 16, 2023 @06:51PM (#38297350)
Now you've got to muck up your app with logic to detect spot-market termination, pausing, and recovery. It's turtles all the way down.
Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by mlrtime on Friday November 17, 2023 @07:20AM (#38302522)
Not really, just a sane ASG policy.

Also, there are companies that manage spot price allocation for you, so you should essentially always pay spot+small_x% and never actually get terminated.

Re:Moving from AWS to Bare-Metal saved us 230k$ /yr by belter on Friday November 17, 2023 @07:54AM (#38302831)
Its not clear if they could have used Spot for most of the workloads, then they would be looking at 70 to 80% price reduction over On-Demand. They dont clarify their requirements for RTO. Because they are now at a single data center...