I’ve heard 100 mi figure, but can’t confirm/remember where.
1. Apple On-Device
2. Apple Server
3. GPT-4o
Apple Silicon/Mx, iPad, iPhone 15 Pro can access all three.
All other devices can still access Apple Server and GPT-4o. So, I'd expect the incompatible devices to actually hammer OpenAI more.
This is a strawman. No one on this thread said it does.
That said, it does - even if only partially, even if only with explicit permission, even if only in certain circumstances.
But 100m figure seems small. There are ~100m Apple Silicon Macs sold in the last 4 years. That's not including any M1+ iPads or iPhone 15 Pros.
I'm guessing maybe 250m? Still a ton of queries and usage. It's not just Siri. I believe features like optimize email response also uses GPT4o.
If they allowed your private email contents or any other private context to leak outside their encrypted enclave (local or their new online hardware) then the entire set of privacy claims would go out the window.
I think the Apple server inference is handling things like image generation where you need a beefy guy to get results quickly, and don’t need to transmit as much user context to service the request.
If I'm a paid ChatGPT user, I'd definitely choose GPT4 over Apple's models.
> With ChatGPT from OpenAI integrated into Siri and Writing Tools, you get even more expertise when it might be helpful for you — no need to jump between tools. Siri can tap into ChatGPT for certain requests, including questions about photos or documents. And with Compose in Writing Tools, you can create and illustrate original content from scratch.
* got one of my own right before a previous employer closed down and let us keep the work one, third one is from new employer
"* Apple Intelligence will be available in beta on iPhone 15 Pro, iPhone 15 Pro Max, and iPad and Mac with M1 and later, with Siri and device language set to U.S. English, as part of iOS 18, iPadOS 18, and macOS Sequoia this fall."
(Given how rapidly AI changes, anything more than a year away isn't easily planned for, even assuming no surprises on the anti-trust front for every Big Tech company nor any surprise new legal obligations for AI).
Microsoft Azure is handling the traffic.
And Apple would never enter into such a deal without proper capacity planning.
And Satya would love nothing more than to drive Apple and Google apart.
It's possible that Apple sees it as a future app store-like revenue. You can use any AI model you want, and if you want to subscribe to Gemini Pro or ChatGPT Plus, Apple takes 30%.
I was certain that Apple wants to create their own cutting edge LLM to compete with GPT4 or Gemini or Claude or Mixtral. But they've decided to instead, open up all their platforms to 3rd party models.
I suppose Apple may still want to create an Apple Intelligence Pro in the future but their models aren't leading at the moment.
Apple has had countless partnerships over the years eg. Foursquare, Google, Sensis that don't require a 15/30% commission.
It doesn't even make sense how or why they would implement an IAP flow directly into the OS.
You're adding a few billion devices to do inference for if you're OpenAI without knowing the conversion rate from free to paid ChatGPT accounts from Apple users.
Also, can OpenAI really handle that much more traffic? Sometimes my paid ChatGPT account stalls or is slow even as of June 2024. Now they're going to add a few billion more users/devices at once. That's insane. How are they going to do this?