News for hackers. Stuff that matters.

A comment on Forget ChatGPT: why researchers now run small AIs on their laptops. Parent comment

Re:Forget ChatGPT: why researchers now run small AIs on thei... by soco on Monday September 23, 2024 @09:50AM (#41626077)
Fully agree with you, it should, but after trying a few times different llamas I think they're very far from "try it out in just a few moments". Unless all you want is to see one running, for anything beyond that you'll be in dependency hell...
[ Parent | on HN ]
Re:Forget ChatGPT: why researchers now run small AIs on thei... by jonnycomputer on Monday September 23, 2024 @10:59AM (#41626882)
If you just want to chat, download https://lmstudio.ai/, then download their recommended LLM files, and you're good to go. Really that simple these days.
[ Parent | on HN ]
Re:Forget ChatGPT: why researchers now run small AIs on thei... by thebiss on Monday September 23, 2024 @04:09PM (#41629951)
lmstudio prohibits commercial use [1]:

> Subject to the Agreement, Company grants you a limited license to reproduce portions of Company Properties for the sole purpose of using the Services for your personal, non-commercial purposes.

[1] https://lmstudio.ai/terms

[ Parent | on HN ]
Re:Forget ChatGPT: why researchers now run small AIs on thei... by noman-land on Monday September 23, 2024 @10:39AM (#41626654)
There is no dependency hell. It's just a single file. If you want to get into trying different models and various settings, you can use LM Studio, and still no need to worry about dependencies.
[ Parent | on HN ]