News for hackers. Stuff that matters.
Re:LM Studio – Discover, download, and run local LLMs by akx on Wednesday November 22, 2023 @07:36AM (#38378371)
Just compile llama.cpp's server example, and you have a local HTTP API. It also has a simple UI (disclaimer: to which I've contributed).

https://github.com/ggerganov/llama.cpp/blob/master/examples/...

There are no comments on this comment yet.