News for hackers. Stuff that matters.

A comment on Apple introduces M4 chip. Parent comment

Re:Apple introduces M4 chip by Wytwwww on Friday May 10, 2024 @02:25PM (#40322233)
You won't be able to run any model even as remotely as capable as Gemini locally though.
[ Parent | on HN ]
Re:Apple introduces M4 chip by cbsmith on Monday May 13, 2024 @03:01PM (#40346956)
It's kind of tautological that Gemini Nano is as capable as Gemini and it runs locally.

https://store.google.com/intl/en/ideas/articles/pixel-featur...

[ Parent | on HN ]
Re:Apple introduces M4 chip by Wytwwww on Wednesday May 15, 2024 @03:16PM (#40371126)
Yeah, I was thinking of their non-local model like Gemini advanced though.

In any case iPhone probably don't have enough memory to run a 3.25B model? e.g. 15 pro only have 8 GB (and Gemini Nano seems to only work on the 12GB Pixel 8 Pro) and 14 has only 6GB, that hardly seems sufficient for even a small LLM if you still you want to run the full OS and other apps at the same time.

[ Parent | on HN ]