Re:Apple introduces M4 chip
by SpaceManNabs on Tuesday May 07, 2024 @03:42PM
(#40290613)
> Where are you picking up that this is everyone’s strategy?
Read what their engineers say in public. Unless I hallucinated years of federated learning.
Also apple isn't even a player yet and everyone is discussing how they are moving stuff to the edge lol. Can't critique companies for not being on the edge yet when apple doesn't have anything out there.
Re:Apple introduces M4 chip
by smj-edison on Tuesday May 07, 2024 @10:00PM
(#40293641)
I believe at least Google is starting to do edge inference—take a look at the pixel 8 line-up they just announced. It doesn't seem to be emphasized as much, but the tensor G3 chip certainly has builtin inference.
Of course Google is. That's what Gemini Nano is for.
Re:Apple introduces M4 chip
by SpaceManNabs on Wednesday May 15, 2024 @03:43PM
(#40371451)
8 days after this comment, Google announced Gemini Nano local inference for Chrome.
The biggest players in commercial AI models at the moment - OpenAI and Google - have made absolutely no noise about pushing inference to end user devices at all. Microsoft, Adobe, other players who are going big on embedding ML models into their products, are not pushing those models to the edge, they’re investing in cloud GPU.
Where are you picking up that this is everyone’s strategy?