Re:$2 H100s: How the GPU Rental Bubble Burst
by ranger_danger on Friday October 11, 2024 @12:10AM
(#41806030)
Blackwell B100/B200 did kinda rain down, also the AMD MI300X and increased availability of H200.
There's also cheaper NVIDIA L40/L40S if you don't need FP64.
Re:$2 H100s: How the GPU Rental Bubble Burst
by askl on Friday October 11, 2024 @12:39AM
(#41806189)
I'm hoping for the first one
Re:$2 H100s: How the GPU Rental Bubble Burst
by marcyb5st on Friday October 11, 2024 @01:48AM
(#41806573)
There's option 3: current capacity is enough for our AI needs and so GPUs now the market is flooded.
I think AI is not gonna die even in its current stocastic parrot incarnation. It is a useful tool for some tasks and, albeit not transformative like some CEOs, I believe it's gonna stay.
At most I believe we will enter another AI winter until there's the next algorithmic breakthrough.
Re:$2 H100s: How the GPU Rental Bubble Burst
by friendzis on Friday October 11, 2024 @02:00AM
(#41806636)
Current stochastic parrots do not have to be transformative, they have to appear smart enough for a critical mass of dumb enough people. And judging anecdotally from scanning social media - they already do.
Even here, on HN, you find numerous comments of the shape: "${my favorite gpt} says this: <insert some gibberish>"
Either AI is super dead, or a new alien GPU rained from the sky