If you're just using their completions/chat API, you're gonna be ok. As an ultimate fallback you can spin up H100s in the cloud and run VLLM atop a high param open model like Llama 70B. Such models will catch up and their param counts will increase.. eventually. But initially expect gpt-3.5-esque performance. VLLM will give you an OpenAI-like REST API atop a range of models. Keep making things :))

Thx. I will. My current interests mainly lies in benchmarking their vision model.

That being said, I might not go further relying on their APIs for something more serious

Microsoft owns it. I honestly can not imagine trying to build a business on an API owned by Microsoft of all companies.

What makes you say that?

Microsoft seems like one of the more reliable partners to build on compared to Google etc. just for the simple reason that their customers are large businesses and not breaking things for them is in their blood. Just like Windows backwards compatibility.

Would like to elaborate a bit?

Though my investment will be still tiny at the moment, but not other multi-modal model on the market right is as good.

I actually wouldn't be worried in the short term for exactly this reason. Microsoft has legal access to GPT-4 and is allowed to host and serve it via Azure. If OpenAI somehow tanks its API in the near term, MS is sitting on a gold mine and will make use of that by continuing to serve it. In the long term I am worried, but less worried if Sam and Greg form a competing co to continue to build.

People have been successfully building on MS APIs for at least four decades now. I've been for nearly three.

What exactly are you saying?

Why would you build a business that Microsoft could sherlock in a second?

Isn't Microsoft famous for their insane API stability and backwards compatibility?

While I think the sentiment is overblown, if you compare Azure to AWS, Azure's stability is like Google's.

Microsoft Azure is famous for its insanely bad security: https://karl-voit.at/cloud/

Microsoft is famous for a lack of adoption DESPITE backwards compatibility.

Do you use github?

By that logic you could never use a third party API.

If you are building something that is end-user facing that relies on ChatGPT then that was always a huge and risky bet on the future of OpenAI.

In addition, it would likely be some time, possibly years, before it would be ready for production.

Perhaps recent events have just brought that more clearly into focus for you.