News for hackers. Stuff that matters.

A comment on LM Studio – Discover, download, and run local LLMs. Parent comment

Re:LM Studio – Discover, download, and run local LLMs by ParetoOptimal on Thursday November 23, 2023 @03:47PM (#38397346)
> don't understand why anybody would run a "less-good" version locally

Privacy.

If you use llm's on private documents you don't want others to see, you'll likely prefer local models strongly.

[ Parent | on HN ]
Re:LM Studio – Discover, download, and run local LLMs by frankacter on Thursday November 23, 2023 @07:23PM (#38399395)
How would you, in LM Studio or another local option, populate with your own documents? I don't see any option of applying knowledge via pdf/doc/txt.
[ Parent | on HN ]
Re:LM Studio – Discover, download, and run local LLMs by ParetoOptimal on Friday November 24, 2023 @12:46PM (#38406353)
https://github.com/imartinez/privateGPT

https://khoj.dev/

[ Parent | on HN ]