News for hackers. Stuff that matters.
Re:$2 H100s: How the GPU Rental Bubble Burst by pico_creator on Thursday October 10, 2024 @10:58PM (#41805589)
If we $2 H100 this year or next.

Either AI is super dead, or a new alien GPU rained from the sky

Re:$2 H100s: How the GPU Rental Bubble Burst by ranger_danger on Friday October 11, 2024 @12:10AM (#41806030)
Blackwell B100/B200 did kinda rain down, also the AMD MI300X and increased availability of H200.

There's also cheaper NVIDIA L40/L40S if you don't need FP64.

Re:$2 H100s: How the GPU Rental Bubble Burst by askl on Friday October 11, 2024 @12:39AM (#41806189)
I'm hoping for the first one
Re:$2 H100s: How the GPU Rental Bubble Burst by marcyb5st on Friday October 11, 2024 @01:48AM (#41806573)
There's option 3: current capacity is enough for our AI needs and so GPUs now the market is flooded.

I think AI is not gonna die even in its current stocastic parrot incarnation. It is a useful tool for some tasks and, albeit not transformative like some CEOs, I believe it's gonna stay.

At most I believe we will enter another AI winter until there's the next algorithmic breakthrough.

Re:$2 H100s: How the GPU Rental Bubble Burst by friendzis on Friday October 11, 2024 @02:00AM (#41806636)
Current stochastic parrots do not have to be transformative, they have to appear smart enough for a critical mass of dumb enough people. And judging anecdotally from scanning social media - they already do. Even here, on HN, you find numerous comments of the shape: "${my favorite gpt} says this: <insert some gibberish>"