News for hackers. Stuff that matters.

A comment on Apple introduces M4 chip. Parent comment

Re:Apple introduces M4 chip by cbsmith on Tuesday May 07, 2024 @04:00PM (#40290814)
Google has also been working on (and provides kits for) local machine learning on mobile devices... and they run on both iOS and Android. The Gemini App does send data in to Google for learning, but even that you can opt out of.

Apple's definitely pulling a "Heinz" move with privacy, and it is true that they're doing a better job of it overall, but Google's not completely horrible either.

[ Parent | on HN ]
Re:Apple introduces M4 chip by Wytwwww on Friday May 10, 2024 @02:25PM (#40322233)
You won't be able to run any model even as remotely as capable as Gemini locally though.
[ Parent | on HN ]
Re:Apple introduces M4 chip by cbsmith on Monday May 13, 2024 @03:01PM (#40346956)
It's kind of tautological that Gemini Nano is as capable as Gemini and it runs locally.

https://store.google.com/intl/en/ideas/articles/pixel-featur...

[ Parent | on HN ]
Re:Apple introduces M4 chip by Wytwwww on Wednesday May 15, 2024 @03:16PM (#40371126)
Yeah, I was thinking of their non-local model like Gemini advanced though.

In any case iPhone probably don't have enough memory to run a 3.25B model? e.g. 15 pro only have 8 GB (and Gemini Nano seems to only work on the 12GB Pixel 8 Pro) and 14 has only 6GB, that hardly seems sufficient for even a small LLM if you still you want to run the full OS and other apps at the same time.

[ Parent | on HN ]