LM Studio – Discover, download, and run local LLMs

Re:LM Studio – Discover, download, and run local LLMs by omneity on Wednesday November 22, 2023 @08:09AM (#38378648)

I really like LM Studio and had it open when I came across this post. LM Studio is an interesting mixture of:

- A local model runtime

- A model catalog

- A UI to chat with the models easily

- An openAI compatible API

And it has several plugins such as for RAG (using ChromaDB) and others.

Personally I think the positioning is very interesting. They're well positioned to take advantage of new capabilities in the OS ecosystem.

It's still unfortunate that it is not itself open-source.

[ Parent | on HN ]

Re:LM Studio – Discover, download, and run local LLMs by addandsubtract on Wednesday November 22, 2023 @09:32AM (#38379692)

Does it also let you connect to the ChatGPT API and use it?

[ Parent | on HN ]

Re:LM Studio – Discover, download, and run local LLMs by omneity on Wednesday November 22, 2023 @09:38AM (#38379782)

I haven’t found that option. I know it exists in Gpt4all though.

Personally I use a locally served frontend to use ChatGPT via API.

[ Parent | on HN ]

Re:LM Studio – Discover, download, and run local LLMs by SOLAR_FIELDS on Wednesday November 22, 2023 @12:19PM (#38382028)

How does it compare with something like FastChat? https://github.com/lm-sys/FastChat

Feature set seems like a decent amount of overlap. One limitation of FastChat, as far as I can tell, is that one is limited to the models that FastChat supports (though I think it would be minor to modify it to support arbitrary models?)

[ Parent | on HN ]

Re:LM Studio – Discover, download, and run local LLMs by gmgmgmgmgm on Wednesday November 22, 2023 @07:12PM (#38387231)

One, LMStudio, is an app. you download it, run it, you're immediately working

The other is some python thing that requires python knowledge of creating virtual environments, installing dependencies, etc...

[ Parent | on HN ]