News for hackers. Stuff that matters.

A comment on Run LLMs on Apple Neural Engine (ANE). Parent comment

Re:Run LLMs on Apple Neural Engine (ANE) by anemll on Sunday May 04, 2025 @12:25AM (#43884485)
Memory bandwidth is the main bottleneck. It got better with M3/M4. ANE is really fast in FLOPS but low in memory bandwidth.
[ Parent | on HN ]

There are no comments on this comment yet.