Re:AMD Instinct MI325X in Q4 2024, 288GB of HBM3E
by latchkey on Monday June 03, 2024 @03:22AM
(#40560166)
As someone who's buying them, that is not the price. Nor can you just buy one at a time. They are on a OAM/UBB, which is 8.
Re:AMD Instinct MI325X in Q4 2024, 288GB of HBM3E
by krasin on Monday June 03, 2024 @01:21AM
(#40559581)
People on reddit.com/r/localllama build even more expensive rigs sometimes. Everyone wants to run llama3 70B and eventually the 405B version.
Re:AMD Instinct MI325X in Q4 2024, 288GB of HBM3E
by ein0p on Monday June 03, 2024 @03:31AM
(#40560205)
I’d buy a few at that price. But I can’t.
Re:AMD Instinct MI325X in Q4 2024, 288GB of HBM3E
by ai_what on Monday June 03, 2024 @01:26AM
(#40559608)
I mean it's the price of 2 * Apple Mac Pro's. It isn't exactly unheard of.
Just a few weeks ago I spoke to someone who shelled out $10k for running LLM's locally. I've seen more expensive builds as well.
they're 15k - who exactly is disappointed they won't be able to buy one?