Re:Tim Cook is running out of ideas
by jl6 on Wednesday May 15, 2024 @08:22AM
(#40365973)
I agree. An AI assistant with the following properties would make me upgrade my phone: 1) fully local / ultra low latency; 2) privacy guarantees; 3) access / training / fine-tuning over all the data on my phone.
But it would probably require at least a 10x increase in on-device compute/memory resources to achieve that, unless they can pull off an efficiency miracle (1.58bit models?).
But it would probably require at least a 10x increase in on-device compute/memory resources to achieve that, unless they can pull off an efficiency miracle (1.58bit models?).