AMD EPYC 9004 Genoa Under-the-Lid – ServeTheHome

Re:AMD EPYC 9004 Genoa Under-the-Lid – ServeTheHome by bob1029 on Tuesday February 21, 2023 @10:05AM (#34881961)

Looks like ~$12k per unit. Not even half a year of our cloud spend. The economics around this are pretty hilarious to me now.

If we were to consolidate all of the processing power across our Azure/AWS VMs, we would not be at even 30% of what this part can handle. You could even throw in the IT stack of our entire parent org with room to spare.

The only reason we are still in the cloud is the deep compliance packages that our customers really enjoy. Even so, management is starting to consider alternatives.

I know a lot of us can't stand the idea, but the notion of putting the entire company on 1 socket is super compelling to me. On-prem turns into a dragon for me when I have to manage 10+ machines and related vendors. 2-3 machines and a handful of vendors is more manageable.

One thing is certain - The various cloud providers will take every ounce of AMD's performance innovation and make it feel like a negligible improvement to their end customers.

[ Parent | on HN ]

Re:AMD EPYC 9004 Genoa Under-the-Lid – ServeTheHome by unethical_ban on Tuesday February 21, 2023 @10:55AM (#34882530)

Accounting: Hardware and software acquisition is very different at an accounting level in large orgs, and come from different budgets. Licensing and support can be easier to procure and plan for than hardware.

APIs/RBAC: Cloud infrastructure-as-code for block storage, object storage, DB, network, VM and serverless with the same security policy language accessible via HTTP is really incredible. I wish there were an open-source cloud equivalent, but I don't know of one that can do 20% of what AWS can do.

[ Parent | on HN ]

Re:AMD EPYC 9004 Genoa Under-the-Lid – ServeTheHome by bob1029 on Tuesday February 21, 2023 @11:25AM (#34882968)

> I don't know of one that can do 20% of what AWS can do.

We only use a few AWS products: Route53, EC2, VPC, EBS, and S3/Glacier. This feels like <20% of what AWS can do today.

Are these use cases not yet covered? I'd be OK with Route53 not being in the box, but surely we have VMs, storage and backups sorted by now, right?

[ Parent | on HN ]

Re:AMD EPYC 9004 Genoa Under-the-Lid – ServeTheHome by mwcampbell on Tuesday February 21, 2023 @03:26PM (#34886621)

How do you deploy your applications onto your EC2 instances? Do you create application-specific AMIs, use something like Ansible, something Windows-specific like WinRM, run your own container setup on EC2, or something else?

[ Parent | on HN ]

Re:AMD EPYC 9004 Genoa Under-the-Lid – ServeTheHome by bob1029 on Tuesday February 21, 2023 @03:53PM (#34887099)

Our software has integral CI/CD capabilities. All built in-house. Once our services are installed on a machine, they can be upgraded from a centralized system.

First time setup is manual, but it could be automated if we got bored of the task. The binary distribution requires zero dependencies on the machine and brings its own database with it so bootstrapping is very easy.

[ Parent | on HN ]

Re:AMD EPYC 9004 Genoa Under-the-Lid – ServeTheHome by pclmulqdq on Tuesday February 21, 2023 @01:48PM (#34885090)

Keep in mind that you need to put this in a server with DIMMs, power supplies, and disks. It will likely come out to $20-30k all in for one server depending on how much margin your system integrator wants. You probably want two in case the first one fails, and you may want as many as 3-4 for true 24/7 availability, plus a backup service.

The math still doesn't look too good for the cloud, though.

[ Parent | on HN ]

Re:AMD EPYC 9004 Genoa Under-the-Lid – ServeTheHome by gary_0 on Tuesday February 21, 2023 @01:56PM (#34885244)

> putting the entire company on 1 socket

What about availability? Do you mean 1 socket, plus a hot backup in a separate location in case of hardware failure or some catastrophe?

IIRC, Hacker News runs on 1 machine plus a hot backup.

[ Parent | on HN ]

Re:AMD EPYC 9004 Genoa Under-the-Lid – ServeTheHome by justsomehnguy on Tuesday February 21, 2023 @02:42PM (#34885946)

Most of the time 'availability' means network connectivity. Most of the time you can throw resources in the processing.

[ Parent | on HN ]