Re:Apple introduces M4 chip
by Wytwwww on Wednesday May 15, 2024 @03:16PM
(#40371126)
Yeah, I was thinking of their non-local model like Gemini advanced though.
In any case iPhone probably don't have enough memory to run a 3.25B model? e.g. 15 pro only have 8 GB (and Gemini Nano seems to only work on the 12GB Pixel 8 Pro) and 14 has only 6GB, that hardly seems sufficient for even a small LLM if you still you want to run the full OS and other apps at the same time.
In any case iPhone probably don't have enough memory to run a 3.25B model? e.g. 15 pro only have 8 GB (and Gemini Nano seems to only work on the 12GB Pixel 8 Pro) and 14 has only 6GB, that hardly seems sufficient for even a small LLM if you still you want to run the full OS and other apps at the same time.