Re:Ollama releases OpenAI API compatibility
by tracerbulletx on Thursday February 08, 2024 @06:22PM
(#39309193)
It's so trivially easy to create your own web server in your language of choice that calls directly into llama.cpp functions with the bindings for your language of choice it doesn't really matter all that much. If you want more control you can get with just a little more work. You don't really need these plug and play things.
[ Parent
| on HN ]
There are no comments on this comment yet.