Re:Run LLMs on Apple Neural Engine (ANE)
by kamranjon on Saturday May 03, 2025 @03:10PM
(#43881335)
Not switching to the CPU - switching to the ANE (Neural Cores) - if you read the research papers Apple has released - the example I gave is pretty much how it's being used - small image classification models running on the ANE, alongside a graphics app that needs the GPU to be free.
[ Parent
| on HN ]