News for hackers. Stuff that matters.
Re:Run LLMs on Apple Neural Engine (ANE) by Spooky23 on Saturday May 03, 2025 @03:58PM (#43881736)
My little $599 Mac Mini does inference about 15-20% slower than a 5070 in my kids’ gaming rig. They cost about the same, and I got a free computer.

Nvidia makes an incredible product, but apples different market segmentation strategy might make it a real player in the long run.

There are no comments on this comment yet.