News for hackers. Stuff that matters.

A comment on Nvidia's Chat with RTX is a promising AI chatbot that runs locally on your PC. Parent comment

Re:Nvidia's Chat with RTX is a promising AI chatbot that run... by theshrike79 on Tuesday February 13, 2024 @12:03PM (#39359859)
https://lmstudio.ai

You can use it to directly search any models, download and run 100% locally.

M-series Macs are the simplest, they Just Work. Even faster if you tick the GPU box.

Windows needs the right kind of GPU to get workable speed.

[ Parent | on HN ]
Re:Nvidia's Chat with RTX is a promising AI chatbot that run... by thejohnconway on Tuesday February 13, 2024 @12:30PM (#39360186)
Can that interact with files on your computer, like they show in the video?
[ Parent | on HN ]
Re:Nvidia's Chat with RTX is a promising AI chatbot that run... by operator-name on Tuesday February 13, 2024 @01:04PM (#39360664)
Last time I used it, LM Studio doesn't include RAG.
[ Parent | on HN ]
Re:Nvidia's Chat with RTX is a promising AI chatbot that run... by mrdatawolf on Tuesday February 13, 2024 @02:35PM (#39361806)
I just installed it yesterday and you are right it does not seem to have RAG but you can use something like anythingLLM to do the rag work and ut has built in integration with studio LM.
[ Parent | on HN ]