> How these models perform in those tasks is paramount,

Then you have no choice bit to use your own hosted model because that's the only way you can be sure the model isn't going to be removed or quantized/nerfed behind your back.

If your system can widstand the fluctuations of closed models over time, then it can most likely support switching between multiple providers in the first place.