News for hackers. Stuff that matters.
Re:My local model setup on an M4 Pro Mac Mini by ActorNightly on Thursday September 03, 2026 @12:31PM (#49552763)
Just ollama if you are feeling lazy. With ollama, pull the model (start with https://ollama.com/library/gemma3:27b), and `ollama run gemma3:27b`

If you want to build agentic frameworks, use llama.cpp with its built in http server, and build the framework with python

There are no comments on this comment yet.