News for hackers. Stuff that matters.
Re:My AI skeptic friends are all nuts by fennecbutt on Tuesday June 03, 2025 @05:41AM (#44168124)
Yeah, for £10,000. And you get 512GB of bandwidth starved memory.

Still, I suppose that's better than what nvidia has on offer atm (even if a rack of gpus gives you much, much higher memory throughput).

Re:My AI skeptic friends are all nuts by theshrike79 on Tuesday June 03, 2025 @06:33AM (#44168408)
AKCSHUALLY the M-series CPU memory upgrades are expensive because the memory is on-chip and the bandwidth is a lot bigger than on comparable PC hardware.

In some cases it's more cost effective to get M-series Mac Minis vs nVidia GPUs

Re:My AI skeptic friends are all nuts by lolinder on Tuesday June 03, 2025 @07:56AM (#44169001)
They know that, but all accounts I've read acknowledge that the unified memory is worse than dedicated VRAM. It's just much better than running LLMs on CPU and the only way for a regular consumer to get to 64GB+ of graphical memory.
Re:My AI skeptic friends are all nuts by hu3 on Tuesday June 03, 2025 @10:47AM (#44170711)
It's still magnitude slower than AI GPUs.

And with $10k I could pay 40 years of Claude subscription. A much smarter and faster model.

Re:My AI skeptic friends are all nuts by onemoresoop on Tuesday June 03, 2025 @12:45PM (#44171962)
Claude subscription is $20 but is that all you're using? If you want to get the best of Claude it'll cost you a few hundred+ a month.