Re:My local model setup on an M4 Pro Mac Mini
by brettdav on Thursday September 03, 2026 @11:27PM
(#49560183)
Yes, that makes sense. Some of my models currently run in ollama while others require their own inference servers. Iām curious about custom inference servers in bifrost and the ability to orchestrate keeping some models warm in memory while evicting and cycling other models. All of which span different providers in bifrost (I think). Obviously I can get the mechanics from an agent, more wondering about any experience with something similar.
[ Parent
| on HN ]
There are no comments on this comment yet.