News for hackers. Stuff that matters.
Re:It's Time to Stop Taking Sam Altman at His Word by mark_l_watson on Saturday October 05, 2024 @12:40PM (#41751093)
+1 for sure running LLMs 3.2 3B is super fast and useful. I have been pushing it for local RAG and code completion also. I bought a 32B memory Mac six months ago, which I now regret because the small local models are now extremely useful and run fine on old 8B memory Macs, and support all the fun experiments I want to do.

There are no comments on this comment yet.