Re:Run LLMs on Apple Neural Engine (ANE)
by seanmcdirmid on Saturday May 03, 2025 @03:23PM
(#43881418)
Unless it’s a large model that doesn’t fit in the 5090, bust that’s no longer a $4k macstudio I think.
[ Parent
| on HN ]
$4k will get you a 96 GB Mac Studio with M3 Ultra (819 GB/sec).
That's 3x the RAM of the 5090.
> That's 3x the RAM of the 5090
And a bit less than half the bandwidth (saying for completeness).