Re:My local model setup on an M4 Pro Mac Mini
by chrisweekly on Wednesday September 02, 2026 @08:41AM
(#49535385)
Try smolvm microvms from https://smolmachines.com - among other benefits they only consume host resources if they're actually used.
Was because I am back to using Linux as my workstation.
My Mac Mini is now a headless server for llama.cpp.
So, you are right that for these workloads , I would not be using the Mac Mini for k8s AND llama.
Another thing going against using a Mac for Linux containers is that there are no solutions that I know that properly manages memory : memory is given to the Linux vm , but never fluctuates if the needs in the vm are less than the initial request.
I know Orb Stack does that but is it proprietary. I think UTM does it , but not sure I would use UTM instead of Lima, Colima , multipass , etc to run containers.