News for hackers. Stuff that matters.

amecon

Ask HN: How bad is the GPU shortage for startups/researchers?

Curious how folks are faring with GPU access for training / inference? (those of us outside of big contracts / commits with the big three)I've seen folks try to address the shortage through a number of mechanisms: - Co-op pool for recipients of a specific AI investment fund - Collating a transparent price book (Shadeform) - People putting a rack under their desks?(Full disclosure, I am...

( Read More... | 4 comments | 12 points | on HN )
Re: on Tuesday August 22, 2023 @11:08AM (#37223864)
Hello HN!

We're gauging interest in short-term cloud-based GPU rentals, and wanted to get a bit of input from the community to understand the size and shape of rental offerings for A100s and H100s.

For those interested, would love to get your responses around price sensitivity vs capacity availability in the form above (only 5 questions).

This pricing would be very competitive when compared with AWS / Azure / etc.

Will require containerizing your workload, and have some forthcoming info on how you'd be able to ensure said workload is secure from the host.

Many thanks.

Re:Ask HN: How do you plan on making money with Open AI API? on Thursday February 02, 2023 @11:28AM (#34628857)
Levered long MSFT
Re:Vendr – moral hazard / rent seeking? on Tuesday January 31, 2023 @12:58PM (#34598840)
##Curious for people's thoughts on Vendr?

They pitch themselves as a friendly buying assistant that can help negotiate good deals - they user their knowledge of other customer's pricing to try to get you discounts.

My experience working with them has been mixed - on the plus side, I've seen their reps get us an extra 5% off a renewal. On the other hand, they have pressured us for NDA-protected pricing data on unrelated negotiations - deals they weren't working on for us.

I wonder what the terminal state of the market is here is? Do software companies lose all pricing autonomy? Seems like textbook definition moral hazard / rent seeking to me (at least) in the short term - in the long term, Vendr will ameliorate their extractable margin to zero, as everyone approaches / reaches uniformly-discounted economics.

Which makes me wonder does the Vendr management team think about the terminal state? - Or have a different view point on where the market will settle? - Or is this just a short term value extract? - Or do Am I being unfair in my assumptions? Curious for other's experiences and thoughts.