News for hackers. Stuff that matters.
Re:Run LLMs on Apple Neural Engine (ANE) by ljosifov on Saturday May 03, 2025 @03:00PM (#43881271)
This more than anything feels emblematic to me, that Apple executives are brain dead when it comes to software. AI seemingly being a step too far. (in the s/w direction.) While they could at some level grok classical s/w, NN-s are that Terra Incognita where Apple executives can not possibly follow in. It's just too strange and mysterious world for them to be able to effectively decide or execute on anything. Worked (20yrs ago) in an industrial R&D lab of a mostly h/w manufacturer for 3 years. It looked to me that the worlds of h/w and s/w, the mindsets, diverged pretty quickly on all important considerations of "what should happen next".
Re:Run LLMs on Apple Neural Engine (ANE) by anon373839 on Saturday May 03, 2025 @06:18PM (#43882829)
Huh? Apple ships heaps of deep learning-based products/features, and they’ve done so for years. But I’ll agree with you, they’re currently behind in generative AI.
Re:Run LLMs on Apple Neural Engine (ANE) by voidspark on Saturday May 03, 2025 @07:46PM (#43883285)
Apple has been using neural networks for many years.

They released the Neural Engine in the iPhone X in 2017. That's a hardware accelerator for neural network inferencing.

The iPhone uses it for facial recognition, image processing, etc. Look up "Apple Deep Fusion". Neural networks are integrated in quite a few Apple applications. They even use them on the Apple Watch.

Apple Vision Pro makes good use of deep learning models for object tracking and environmental understanding.