News for hackers. Stuff that matters.
Re:New iMac with M4 by declan_roberts on Monday October 28, 2024 @12:10PM (#41972717)
Which models are you running? I'm on a M2pro w/ 32gb and I can run meta llama 8B on lmstudio pretty decently while coding.
Re:New iMac with M4 by simonw on Monday October 28, 2024 @12:18PM (#41972828)
Yeah 8B is fine but I really want to run 70B (or even 405B but that's way outside my system at the moment).

I can run 70B at the moment... but not if I also want Firefox and VS Code at the same time.