News for hackers. Stuff that matters.
Re:My local model setup on an M4 Pro Mac Mini by LeBit on Wednesday September 02, 2026 @08:34AM (#49535320)
I actually have a Mac Mini M4 Pro with 48G. I gave the k8s example because this is what I was doing with it.

Was because I am back to using Linux as my workstation.

My Mac Mini is now a headless server for llama.cpp.

So, you are right that for these workloads , I would not be using the Mac Mini for k8s AND llama.

Another thing going against using a Mac for Linux containers is that there are no solutions that I know that properly manages memory : memory is given to the Linux vm , but never fluctuates if the needs in the vm are less than the initial request.

I know Orb Stack does that but is it proprietary. I think UTM does it , but not sure I would use UTM instead of Lima, Colima , multipass , etc to run containers.

Re:My local model setup on an M4 Pro Mac Mini by chrisweekly on Wednesday September 02, 2026 @08:41AM (#49535385)
Try smolvm microvms from https://smolmachines.com - among other benefits they only consume host resources if they're actually used.