I'm pretty sure those points do not apply to ChatGPT integration. ChatGPT is still running on Nvidia.
Re:OpenAI and Apple Announce Partnership
by mistersquid on Monday June 10, 2024 @04:26PM
(#40638541)
> I'm pretty sure those points do not apply to ChatGPT integration.
You’re absolutely right. I got too excited about Apple’s strategy to encourage developers to use Apple Private Cloud Compute.
The UX for ChatGPT as shown for iOS 18 makes it obvious that you are sending data outside the Apple Silicon walled garden.
> If they are serious about the OAI partnership they could also start to supply them with cloud inference hardware and strongarm them into only using apple servers to serve iOS requests
Apple addressed both these points in today’s preso.
1. They will send requests that require larger contexts to their own Apple Silicon-based servers that will provide Apple devices a new product platform called Private Cloud Compute.
2. Apple’s OS generative AI request APIs won’t even talk to cloud compute resources that do not attest to infrastructure that has a publicly available privacy audit.