News for hackers. Stuff that matters.
Re:Run LLMs Locally with an OpenAI API by b33f on Thursday December 21, 2023 @03:18AM (#38718166)
Jan is a local app for running LLM models on Windows/Linux/MacOS, including an OpenAI compatible API.