News for hackers. Stuff that matters.

A comment on I Run LLMs Locally. Parent comment

Re:I Run LLMs Locally by vunderba on Sunday December 29, 2024 @06:39PM (#42544638)
Given how much data (personal and otherwise) that you're likely going to feeding into it, I would HIGHLY recommend using an open-source chat interface like Jan.

It's cross platform, works with most LLMs, and has extension support.

https://github.com/janhq/jan

Another alternative is LibreChat, it's more fully featured but its heavier weight and spins up quite a few docker instances.

https://github.com/danny-avila/LibreChat

If you're going through the trouble of running models locally, it doesn't make sense to couple that with a proprietary closed source interface (like LM Studio).

[ Parent | on HN ]
Re:I Run LLMs Locally by synapsomorphy on Sunday December 29, 2024 @07:09PM (#42544884)
Did you misread? No one mentioned LM studio, open-webui (frontend) is open source and usually uses ollama (backend) which is also open source.

Jan and Librechat are both less popular than either open-webui or ollama, how do their features compare?

[ Parent | on HN ]
Re:I Run LLMs Locally by throwaway314155 on Sunday December 29, 2024 @07:30PM (#42545040)
No one had suggested LM Studio at this point in the thread.
[ Parent | on HN ]