News for hackers. Stuff that matters.

A comment on Apple wants AI to run directly on its hardware instead of in the cloud. Parent comment

Re:Apple wants AI to run directly on its hardware instead of... by mi_lk on Thursday December 21, 2023 @03:36PM (#38726542)
FYI that app is 3.3 GB on iOS, not your typical app size
[ Parent | on HN ]
Re:Apple wants AI to run directly on its hardware instead of... by simonw on Thursday December 21, 2023 @05:03PM (#38727677)
I'd love to know why it's that big. I'm pretty sure it doesn't include the actual LLM model files - the first time you use a model you have to click to download it, and those are likely even larger than 3.3GB.
[ Parent | on HN ]
Re:Apple wants AI to run directly on its hardware instead of... by bm-rf on Thursday December 21, 2023 @06:00PM (#38728314)
It comes with Mistral 7B, Llama 7B and RedPajama are available for download.
[ Parent | on HN ]