News for hackers. Stuff that matters.

A comment on Show HN: San Francisco Compute – 512 H100s at <$2/hr for research and startups. Parent comment

Re:Show HN: San Francisco Compute – 512 H100s at <$2/hr for ... by jiggawatts on Sunday July 30, 2023 @06:45PM (#36936767)
It’s just corporate profits combined with market forces, not a some sort of malicious conspiracy.

You can rent a 2-socket AMD server with 120 available cores and RDMA for something like 50c to $2 per hour. That’s just barely above the cost of the electricity and cooling!

What do you want, free compute just handed to you out of the goodness of their hearts?

There is incredible demand for high-end GPUs right now, and market prices reflect that.

[ Parent | on HN ]
Re:Show HN: San Francisco Compute – 512 H100s at <$2/hr for ... by mikeravkine on Sunday July 30, 2023 @07:38PM (#36937180)
Sorry where are these .50c many core servers you speak of exactly?
[ Parent | on HN ]
Re:Show HN: San Francisco Compute – 512 H100s at <$2/hr for ... by jiggawatts on Monday July 31, 2023 @07:40PM (#36950422)
Azure's HB120rs_v3 size is about 36c per hour right now with Spot pricing in East US. These use 3rd generation AMD EPYC "Milan" processors.

The instances with the 4th generation "Genoa-X" processors (HB176rs_v4) cost about $2.88 per hour. The HX176rs_v4 model with 1.7 TB of memory is $3.46 per hour.

https://learn.microsoft.com/en-us/azure/virtual-machines/hbv...

https://learn.microsoft.com/en-us/azure/virtual-machines/hbv...

https://learn.microsoft.com/en-us/azure/virtual-machines/hx-...

[ Parent | on HN ]
Re:Show HN: San Francisco Compute – 512 H100s at <$2/hr for ... by alex_lav on Monday July 31, 2023 @07:49PM (#36950502)
Are these actually attainable, as in I can log in and launch an instances with these specifications right now, or are they just listings? I ask because literally last week I was unable to launch similar instances on AWS despite those specs being listed as available and online.
[ Parent | on HN ]
Re:Show HN: San Francisco Compute – 512 H100s at <$2/hr for ... by jiggawatts on Thursday August 03, 2023 @06:33PM (#36992981)
I could. Availability tends to be region-dependent with all clouds.
[ Parent | on HN ]
Re:Show HN: San Francisco Compute – 512 H100s at <$2/hr for ... by abraae on Sunday July 30, 2023 @07:03PM (#36936932)
You mentioned malicious conspiracy, not me.

It's just business and I'd do the same if I was in charge of AWS.

[ Parent | on HN ]
Re:Show HN: San Francisco Compute – 512 H100s at <$2/hr for ... by megakwood on Sunday July 30, 2023 @07:44PM (#36937232)
Where can you get 120 cores for $2/hr?
[ Parent | on HN ]
Re:Show HN: San Francisco Compute – 512 H100s at <$2/hr for ... by jiggawatts on Monday July 31, 2023 @07:41PM (#36950426)
https://news.ycombinator.com/item?id=36950422
[ Parent | on HN ]
Re:Show HN: San Francisco Compute – 512 H100s at <$2/hr for ... by alex_lav on Sunday July 30, 2023 @08:22PM (#36937522)
> You can rent a 2-socket AMD server with 120 available cores and RDMA for something like 50c to $2 per hour.

Source required

[ Parent | on HN ]
Re:Show HN: San Francisco Compute – 512 H100s at <$2/hr for ... by jiggawatts on Monday July 31, 2023 @07:41PM (#36950425)
https://news.ycombinator.com/item?id=36950422
[ Parent | on HN ]