Re:Ollama releases OpenAI API compatibility
by Patrick_Devine on Thursday February 08, 2024 @04:49PM
(#39308202)
TBH, we debated about this a lot before adding it. It's weird being beholden to someone else's API which can dictate what features we should (or shouldn't) be adding to our own project. If we add something cool/new/different to Ollama will people even be able to use it since there isn't an equivalent thing in the OpenAI API?
[ Parent
| on HN ]
Re:Ollama releases OpenAI API compatibility
by minimaxir on Thursday February 08, 2024 @04:59PM
(#39308350)
That's more of a marketing problem than a technical problem. If there is indeed a novel use case with a good demo example that's not present in OpenAI's API, then people will use it. And if it's really novel, OpenAI will copy it into their API and thus the problem is no longer an issue.
The power of open source!
Re:Ollama releases OpenAI API compatibility
by Patrick_Devine on Thursday February 08, 2024 @05:16PM
(#39308554)
You're right that it's a marketing problem, but it's also a technical problem. If tooling/projects are built around the compat layer it makes it really difficult to consume those features without having to rewrite a lot of stuff. It also places a cognitive burden on developers to know which API to use. That might not sound like a lot, but one of the guiding principles around the project (and a big part of its success) is to keep the user experience as simple as possible.
Re:Ollama releases OpenAI API compatibility
by satellite2 on Thursday February 08, 2024 @05:22PM
(#39308603)
At some point, (probably in a relatively close future), there will be the AI Consortium (AIC) to decide what enters the common API?