I would recommend just connect your whatever you used or built to a LLM gateway & router to use any models without management complexity.

I built BitRouter(https://github.com/bitrouter/bitrouter), open-sourced, 0 markup for all models, free BYOK/subscription, and works with any harnesses out of the box