Re:M4 MacBook Pro
by xenospn on Wednesday October 30, 2024 @01:29PM
(#41997889)
Which ones in particular? I have an M2 air with 8GB, and doing some RAG development locally would be fantastic. I tried running Ollama with llama3.2 and it predictably bombed.
[ Parent
| on HN ]
Re:M4 MacBook Pro
by mark_l_watson on Thursday October 31, 2024 @12:42PM
(#42008577)
I would have thought that llama3.2:latest would run OK with 8G. Same for phi3.5:latest