Re:My local model setup on an M4 Pro Mac Mini
by ActorNightly on Thursday September 03, 2026 @12:31PM
(#49552763)
Just ollama if you are feeling lazy. With ollama, pull the model (start with https://ollama.com/library/gemma3:27b), and `ollama run gemma3:27b`
If you want to build agentic frameworks, use llama.cpp with its built in http server, and build the framework with python
I have a beefy Linux box with a 4090 but never took the time to set it up properly beyond simple testing; any tutorial you would recommend?