News for hackers. Stuff that matters.
Re:AMD Instinct MI325X in Q4 2024, 288GB of HBM3E by almostgotcaught on Monday June 03, 2024 @12:50AM (#40559433)
> No, you still won't be able to buy a MI300X in Q4 2024.

they're 15k - who exactly is disappointed they won't be able to buy one?

Re:AMD Instinct MI325X in Q4 2024, 288GB of HBM3E by latchkey on Monday June 03, 2024 @03:22AM (#40560166)
As someone who's buying them, that is not the price. Nor can you just buy one at a time. They are on a OAM/UBB, which is 8.
Re:AMD Instinct MI325X in Q4 2024, 288GB of HBM3E by krasin on Monday June 03, 2024 @01:21AM (#40559581)
People on reddit.com/r/localllama build even more expensive rigs sometimes. Everyone wants to run llama3 70B and eventually the 405B version.
Re:AMD Instinct MI325X in Q4 2024, 288GB of HBM3E by ein0p on Monday June 03, 2024 @03:31AM (#40560205)
I’d buy a few at that price. But I can’t.
Re:AMD Instinct MI325X in Q4 2024, 288GB of HBM3E by ai_what on Monday June 03, 2024 @01:26AM (#40559608)
I mean it's the price of 2 * Apple Mac Pro's. It isn't exactly unheard of.

Just a few weeks ago I spoke to someone who shelled out $10k for running LLM's locally. I've seen more expensive builds as well.

Re:AMD Instinct MI325X in Q4 2024, 288GB of HBM3E by bayindirh on Monday June 03, 2024 @05:06AM (#40560656)
> who exactly is disappointed they won't be able to buy one?

HPC centers and research clusters.