Yeah, I was also going to recommend litellm. I've been using it for my LLM assistant app and was able to add support for pretty much any model or provider endpoint by switching out one line of code.