News for hackers. Stuff that matters.

A comment on Apple wants AI to run directly on its hardware instead of in the cloud. Parent comment

Re:Apple wants AI to run directly on its hardware instead of... by simonw on Thursday December 21, 2023 @05:03PM (#38727677)
I'd love to know why it's that big. I'm pretty sure it doesn't include the actual LLM model files - the first time you use a model you have to click to download it, and those are likely even larger than 3.3GB.
[ Parent | on HN ]
Re:Apple wants AI to run directly on its hardware instead of... by bm-rf on Thursday December 21, 2023 @06:00PM (#38728314)
It comes with Mistral 7B, Llama 7B and RedPajama are available for download.
[ Parent | on HN ]