If we $2 H100 this year or next.

Either AI is super dead, or a new alien GPU rained from the sky

Blackwell B100/B200 did kinda rain down, also the AMD MI300X and increased availability of H200.

There's also cheaper NVIDIA L40/L40S if you don't need FP64.

I'm hoping for the first one

There's option 3: current capacity is enough for our AI needs and so GPUs now the market is flooded.

I think AI is not gonna die even in its current stocastic parrot incarnation. It is a useful tool for some tasks and, albeit not transformative like some CEOs, I believe it's gonna stay.

At most I believe we will enter another AI winter until there's the next algorithmic breakthrough.

Current stochastic parrots do not have to be transformative, they have to appear smart enough for a critical mass of dumb enough people. And judging anecdotally from scanning social media - they already do. Even here, on HN, you find numerous comments of the shape: "${my favorite gpt} says this: <insert some gibberish>"

Bruh

Agreed, and I doubt we’ll see one retail at that price even on the secondhand market anytime soon.

That said, could I see them being offloaded in bulk for pennies on the dollar if the (presumed) AI bubble pops? Quite possibly, if it collapses into a black hole of misery and bad investments. In that case, it’s entirely plausible that some enterprising homelabs could snatch one up for a few grand and experiment with model training on top-shelf (if a generation old) kit. The SXMs are going for ~$26-$40k already, which is cheaper than the (worse performing) H100 Add-In Card when brand new; that’s not the pricing you’d expect from a “red hot” marketplace unless some folk are already cutting their losses and exiting positions.

Regardless, interesting times ahead. We either get AI replacing workers en masse, or a bust of the tech industry not seen since the dot-com bubble. Either way, it feels like we all lose.

2 bucks for a GPU? Maybe a PIC microcontroller.

They don't even have HDMI ports so they are pretty useless, but I'd buy one at $2 as a desk ornament.

GPU display stand:

https://www.reddit.com/r/nvidia/comments/1fw68rl/retiring_a_...

You don't need an HDMI port, you just need a driver to support running the right graphics calculations and producing image to funnel to another output port. The GPU may lack some features, may have an architecture that is bad for rendering, and may be suboptimal in delivering the performance per watt. Exactly like how a CPU doesn't have a display port.

Some of the Tesla GPUs are almost at this price per unit on eBay now. I've seen them go for under $15 online.

Here's one for ~$18 inc shipping with 6GB DDR5:

https://www.ebay.com/itm/Nvidia-Tesla-K20X-6GB-90Y2351-C7S15...

That hurts - i used those GPUs before at their peak Now any random GPU in the computer store murders it

Not just gpus, the k20 was at 3.9 Tflops (fp32) and the new iPhone is at 4.3 (fp16). If you don’t need the precision it got passed by the phones

Are these a viable buy?

You’d get better perf training on a current gen phone than that gpu, but it probably functions

Only if ur a collector (so no if ur plugging it in)

It appears this GPU cost $7700 when it launched in 2012? GPUs have gotten that much better that this thing isn't even with $100?

Misleading? Anyone who read this title and thought it was referring to the full purchase price might deserve to be misled.

That is what the title says explicitly. That's how click bait works

It also explicitly says "rental", so I'm not sure how one can possibly arrive at the conclusion that they meant "$2 to own an H100"

It didn't say that at the time, the article still has the submitted title: $2 H100s: How the GPU Bubble Burst

Even so, I genuinely don't see how anyone who might be clicking this article could possibly interpret it the way GP is saying.

Well, case in point, I did. When I read the title I thought – "IIRC these were going for thousands, could they have really dropped so hard? Well, sometimes companies, cars, real estate properties cost $1, but there's always of course a catch. Let's see what the catch is here... <click> ah, it's a 4x reduction of rental price, boring"

Anyone who isn't an "AI" fanatic can and will interpret the title as the sale price :)

Holy fuck.

* walks past gnabgib's desk

"Good morning!"

"Who are you talking to? Me? You haven't specified who you're interacting with. Which morning? Today? What metric are you measuring by good? This is too confusing for me."

"Do you wish me a good morning, or mean that it is a good morning whether I want it or not; or that you feel good this morning; or that it is a morning to be good on?”

The HN title has been editorialized, perhaps recently.

The original article title is:

> $2 H100s: How the GPU Bubble Burst

Agreed, "$2/h" would be the correct unit, "$2" reads to me like a typo.