News for hackers. Stuff that matters.

A comment on $2 H100s: How the GPU Rental Bubble Burst. Parent comment

Re:$2 H100s: How the GPU Rental Bubble Burst by startupsfail on Thursday October 10, 2024 @11:10PM (#41805639)
The screenshot there is 1xH100 PCIE, for $1.604. Which is likely promotional pricing to get customers onboarded.

With promotional pricing it can be $0 for qualified customers.

Note also, how the author shows screenshots for invites for private alpha access. It can be mutually beneficial for the data center to provide discounted alpha testing access. The developer gets discounted access, the data center gets free/realistic alpha testing workflows.

[ Parent | on HN ]
Re:$2 H100s: How the GPU Rental Bubble Burst by electronbeam on Friday October 11, 2024 @12:34AM (#41806171)
The PCIE has much lower perf than even a 1x slice of an SXM
[ Parent | on HN ]
Re:$2 H100s: How the GPU Rental Bubble Burst by pico_creator on Friday October 11, 2024 @02:19AM (#41806746)
I really suggest shopping around. <$2 SXM is a real thing, if your patient enough on the schedule.
[ Parent | on HN ]
Re:$2 H100s: How the GPU Rental Bubble Burst by pico_creator on Friday October 11, 2024 @01:54AM (#41806598)
When I did the screenshot a month ago, it wasn't public info yet.

Now its public: SFCompute list it on their main page - https://sfcompute.com/

And they are *not* the only one

[ Parent | on HN ]
Re:$2 H100s: How the GPU Rental Bubble Burst by ipsum2 on Friday October 11, 2024 @03:08AM (#41807047)
Okay, but you can't actually buy it at that price, it's a pure marketing ploy.
[ Parent | on HN ]
Re:$2 H100s: How the GPU Rental Bubble Burst by pico_creator on Friday October 11, 2024 @03:18AM (#41807100)
Not at $0.5 (which the lower bound in their marketing), but $1.5 is very doable on right times (done so multiple times)

The article says $2. Which is quite consistent for a small cluster

[ Parent | on HN ]
Re:$2 H100s: How the GPU Rental Bubble Burst by ipsum2 on Friday October 11, 2024 @03:19AM (#41807105)
The average consumer cannot. Only those who have access to sfcompute's private beta can access those prices. Once it opens up to the public, the price will increase.
[ Parent | on HN ]
Re:$2 H100s: How the GPU Rental Bubble Burst by zaptrem on Friday October 11, 2024 @05:37AM (#41807889)
Running preprocessing jobs on a $0.5 SFCompute H100 node RN (though price usually bounces up to what you mentioned).
[ Parent | on HN ]
Re:$2 H100s: How the GPU Rental Bubble Burst by shrubble on Friday October 11, 2024 @02:30AM (#41806807)
So are you thinking that the lower price is to get the customer in the door and then when they need the Infiniband connected GPUs to charge them more?
[ Parent | on HN ]