News for hackers. Stuff that matters.
Re:Apple to unveil AI-enabled Safari alongside new operating... by slau on Wednesday May 01, 2024 @02:32AM (#40220200)
Only extremely basic requests are processed on device, like “what time is it”. Anything else is still processed on Apple’s servers.
Re:Apple to unveil AI-enabled Safari alongside new operating... by abalone on Wednesday May 01, 2024 @07:34AM (#40221887)
I think “intelligent search” is going to build on Siri and Spotlight, adding LLM for things like summaries and suggestions.

This should bring a 10x magnitude of improvement and justify hardware upgrades to satiate the RAM and coprocessor thirst of LLMs.

Spotlight does pretty extensive if “traditional” index-based search of your local personal data, along with certain privacy-preserving web queries. You can imagine what on-device LLM-powered summaries would bring to this type of search and suggested actions.