Re:Three senior researchers have resigned from OpenAI
by padolsey on Saturday November 18, 2023 @03:31AM
(#38316959)
If you're just using their completions/chat API, you're gonna be ok. As an ultimate fallback you can spin up H100s in the cloud and run VLLM atop a high param open model like Llama 70B. Such models will catch up and their param counts will increase.. eventually. But initially expect gpt-3.5-esque performance. VLLM will give you an OpenAI-like REST API atop a range of models. Keep making things :))
[ Parent
| on HN ]
Re:Three senior researchers have resigned from OpenAI
by karmasimida on Saturday November 18, 2023 @03:34AM
(#38316982)
Thx. I will. My current interests mainly lies in benchmarking their vision model.
That being said, I might not go further relying on their APIs for something more serious