Re:Apple Intelligence for iPhone, iPad, and Mac
by peppertree on Monday June 10, 2024 @03:43PM
(#40637870)
I think the biggest announcement was the private compute cloud with Apple Silicon. Apple is building up internal expertise to go after Nvidia.
Re:Apple Intelligence for iPhone, iPad, and Mac
by dmix on Monday June 10, 2024 @04:51PM
(#40638906)
Can you explain what that means for someone who missed part of the video today?
Re:Apple Intelligence for iPhone, iPad, and Mac
by theshrike79 on Monday June 10, 2024 @04:57PM
(#40638989)
The Apple Intelligence cloud system uses Apple's own M-series chips, not Nvidia.
Re:Apple Intelligence for iPhone, iPad, and Mac
by ismepornnahi on Monday June 10, 2024 @05:25PM
(#40639317)
Because they will be running inference using much smaller models than GPT 4.
Re:Apple Intelligence for iPhone, iPad, and Mac
by int_19h on Monday June 10, 2024 @11:25PM
(#40641948)
At least they are honest about it in the specs that they have published - there's a graph there that clearly shows their server-side model underperforming GPT-4. A refreshing change from the usual "we trained a 7B model and it's almost as good as GPT-4 in tests" hype train.
(see "Apple Foundation Model Human Evaluation" here: https://machinelearning.apple.com/research/introducing-apple...)
Re:Apple Intelligence for iPhone, iPad, and Mac
by theshrike79 on Tuesday June 11, 2024 @12:29AM
(#40642344)
Yea, their models are more targeted. You can't ask Apple Intelligence/Siri about random celebrities or cocktail recipes.
But you CAN ask it to show you all pictures you took of your kids during your vacation to Cabo in 2023 and it'll find them for you.
The model "underperforms", but not in the ways that matter. This is why they partnered with OpenAI, to get the generic stuff included when people need it.
Re:Apple Intelligence for iPhone, iPad, and Mac
by yborg on Monday June 10, 2024 @06:02PM
(#40639696)
Isn't it also that Nvidia chips are basically unobtainable right now anyway?
Re:Apple Intelligence for iPhone, iPad, and Mac
by solarmist on Tuesday June 11, 2024 @11:34AM
(#40647495)
Yeah, but Apple wouldn’t care either way. They do things for the principle of it. “We have an ongoing beef with NVIDIA so we’ll build our own ai server farms.”
Re:Apple Intelligence for iPhone, iPad, and Mac
by teruakohatu on Monday June 10, 2024 @06:02PM
(#40639707)
Apple have a long antagonist relationship with NVIDIA. If anything it is holding Apple back because they don’t want to go cap in hand to NVIDIA and say “please sir, can I have some more”.
We see this play out with the ChatGPT integration. Rather than hosting GPT-4o themselves, OpenAI are. Apple is providing NVIDIA powered AI models through a third party, somewhat undermining the privacy first argument.
Re:Apple Intelligence for iPhone, iPad, and Mac
by hmottestad on Monday June 10, 2024 @06:20PM
(#40639876)
Rumours say that Apple has bought a lot of GPUs from Nvidia in the last year or so in order to train their own models.
Re:Apple Intelligence for iPhone, iPad, and Mac
by s3p on Tuesday June 11, 2024 @03:17PM
(#40650294)
Not really. They use ChatGPT as a last resort for a question that isn't related to the device or an Apple-related interaction. Ex: "Make a recipe out of the foods in this image" versus "how far away is my mom from the lunch spot she told me about". And in that instance they ask the user explicitly whether they want to use ChatGPT.
Re:Apple Intelligence for iPhone, iPad, and Mac
by buildbot on Monday June 10, 2024 @03:16PM
(#40637415)
Yeah I feel like we are getting the crumbs for a future hardware announcement, like M4 ultra. They’ll announce it like “we are so happy to share our latest and greatest processor, a processor so powerful, we’ve been using it in our private AI cloud. We are pleased to announce the M4 Ultra”
Re:Apple Intelligence for iPhone, iPad, and Mac
by samatman on Monday June 10, 2024 @04:00PM
(#40638098)
It was speculated when the M4 was released only for the iPad Pro that it might be out of an internal need on Apple's part for the bulk of the chips being manufactured. This latest set of announcements gives substantial weight to that theory.
Re:Apple Intelligence for iPhone, iPad, and Mac
by buildbot on Monday June 10, 2024 @04:24PM
(#40638513)
Yeah that seems very reasonable/likely. The release of the training toolkit for Apple silicon too points that way: https://github.com/ml-explore/mlx-examples/tree/main/transfo...
Re:Apple Intelligence for iPhone, iPad, and Mac
by hawski on Monday June 10, 2024 @04:59PM
(#40639018)
I see what they did here and it is smart, but can bring chaos. On one side it is like saying "we own it", but on the other hand it is putting a brand outside of their control. Now I only hope people will not abbreviate it with ApI, because it will pollute search results for API :P
Re:Apple Intelligence for iPhone, iPad, and Mac
by tonynator on Monday June 10, 2024 @10:14PM
(#40641574)
Yeah real smart move to make your products initials unusable and unsearchable. Apple has done it again
Re:Apple Intelligence for iPhone, iPad, and Mac
by iansinnott on Monday June 10, 2024 @10:26PM
(#40641633)
Indeed. I suppose they are hoping people will associate the two letters with their thing rather than the original acronym.
imo, apple will gain expertise to serve a monster level of scale for more casual users that want to generate creative or funny pictures, emojis, do some text work, and enhance quality of life. I don't think Apple will be at the forefront of new AI technology to integrate those into user facing features, but if they are to catch up, they will have to get into the forefront of the same technologies to support their unique scale.
Was a notable WWDC, was curious to see what they would do with the Mac Studio and Mac Pro, and nothing about the M3 Ultra or M4 Ultra, or the M3/M4 Extreme.
I also predicted that they would use their own M2 Ultras and whatnot to support their own compute capacity in the cloud, and interestingly enough it was mentioned. I wonder if we'll get more details on this front.