News for hackers. Stuff that matters.

A comment on Qwen3.8-27B on the iPhone 18 Neural Engine at 15–70 tok/s (1.5 bpw). Parent comment

Re:Qwen3.8-27B on the iPhone 18 Neural Engine at 15–70 tok/s... by anemll on Saturday October 17, 2026 @02:24PM (#50133649)
It's warm but not hot. On M6 it's about 50% less energy consumption in my tests vs GPU. I think iPhone should be similar
[ Parent | on HN ]

There are no comments on this comment yet.