News for hackers. Stuff that matters.

A comment on Local LLM inference – impressive but too hard to work with. Parent comment

Re:Local LLM inference – impressive but too hard to work with by mh- on Monday April 21, 2025 @11:16PM (#43758801)
Can anyone vouch for this? I (personally) don't mind that it's closed source, but I've never heard of it and can't find much about it. Website makes it look fantastic though, so I'm intrigued. But am hesitating at giving it all of my API keys..
[ Parent | on HN ]
Re:Local LLM inference – impressive but too hard to work with by ivape on Tuesday April 22, 2025 @02:12PM (#43764818)
Reddit is probably your best bet. I think we all take some risk, even with something like LMStudio which is closed source, since all these apps are basically a new genre.
[ Parent | on HN ]