News for hackers. Stuff that matters.
Re:Run LLMs on Apple Neural Engine (ANE) by voidspark on Saturday May 03, 2025 @03:58PM (#43881728)
$4k will get you a 96 GB Mac Studio with M3 Ultra (819 GB/sec).

That's 3x the RAM of the 5090.

Re:Run LLMs on Apple Neural Engine (ANE) by mdp2021 on Saturday May 03, 2025 @07:47PM (#43883295)
> That's 3x the RAM of the 5090

And a bit less than half the bandwidth (saying for completeness).