News for hackers. Stuff that matters.
Re:Tim Cook is running out of ideas by JKCalhoun on Wednesday May 15, 2024 @08:16AM (#40365909)
> But while AI might drive short-term investor interest ... it's unlikely to be the kind of product that makes a big difference to the bottom line

I guess I disagree. Custom silicon, running a local AI (no network or network agency) in your pocket would be a game changer. Apple has to move fast to catch up on the software, but they own the hardware already, can design the AI-forward silicon.

Re:Tim Cook is running out of ideas by jl6 on Wednesday May 15, 2024 @08:22AM (#40365973)
I agree. An AI assistant with the following properties would make me upgrade my phone: 1) fully local / ultra low latency; 2) privacy guarantees; 3) access / training / fine-tuning over all the data on my phone.

But it would probably require at least a 10x increase in on-device compute/memory resources to achieve that, unless they can pull off an efficiency miracle (1.58bit models?).

Re:Tim Cook is running out of ideas by cmsj on Wednesday May 15, 2024 @08:22AM (#40365971)
Apple has included NPU hardware in its SoCs since the A11 in 2017. It has been used for a variety of local AI in your pocket since then. This "Neural Engine" has only gotten more powerful with each iteration of their SoC in the intervening years.