News for hackers. Stuff that matters.
Re:Code Llama, a state-of-the-art large language model for c... by ssalka on Thursday August 24, 2023 @05:01PM (#37254504)
GPT4All satisfies these requirements, except for (AFAIK) running a web server

https://gpt4all.io/index.html

Re:Code Llama, a state-of-the-art large language model for c... by simonw on Thursday August 24, 2023 @05:19PM (#37254678)
It runs a web server too - if you start up the desktop app it can run a web server with an API on a port for you.