News for hackers. Stuff that matters.
Re:Run LLMs on Apple Neural Engine (ANE) by loh on Saturday May 03, 2025 @07:27PM (#43883183)
Yeah, I looked all over for a comparison and couldn't find anything in the repo, on their social media, etc. I saw some other comments here that said it's supposed to be "15.8 fp16 ops compared to 14.7 fp32 ops" but that isn't really enough to go on. Maybe when I have the time I'll install their TestFlight app and do some comparisons myself.

There are no comments on this comment yet.