News for hackers. Stuff that matters.

A comment on Nvidia's Chat with RTX is a promising AI chatbot that runs locally on your PC.

Re:Nvidia's Chat with RTX is a promising AI chatbot that run... by vdaea on Tuesday February 13, 2024 @10:44AM (#39358647)
I suppose this app despite running locally will also be heavily censored.

Is there some local chatbot application like this, for Windows, that isn't hell to set up and that is not censored?

[ Parent | on HN ]
Re:Nvidia's Chat with RTX is a promising AI chatbot that run... by theshrike79 on Tuesday February 13, 2024 @12:03PM (#39359859)
https://lmstudio.ai

You can use it to directly search any models, download and run 100% locally.

M-series Macs are the simplest, they Just Work. Even faster if you tick the GPU box.

Windows needs the right kind of GPU to get workable speed.

[ Parent | on HN ]
Re:Nvidia's Chat with RTX is a promising AI chatbot that run... by thejohnconway on Tuesday February 13, 2024 @12:30PM (#39360186)
Can that interact with files on your computer, like they show in the video?
[ Parent | on HN ]
Re:Nvidia's Chat with RTX is a promising AI chatbot that run... by operator-name on Tuesday February 13, 2024 @01:04PM (#39360664)
Last time I used it, LM Studio doesn't include RAG.
[ Parent | on HN ]
Re:Nvidia's Chat with RTX is a promising AI chatbot that run... by mrdatawolf on Tuesday February 13, 2024 @02:35PM (#39361806)
I just installed it yesterday and you are right it does not seem to have RAG but you can use something like anythingLLM to do the rag work and ut has built in integration with studio LM.
[ Parent | on HN ]
Re:Nvidia's Chat with RTX is a promising AI chatbot that run... by purpleflame1257 on Tuesday February 13, 2024 @12:18PM (#39360059)
You can start with Kobold.cpp which should handhold you through the process.
[ Parent | on HN ]
Re:Nvidia's Chat with RTX is a promising AI chatbot that run... by fortran77 on Tuesday February 13, 2024 @12:26PM (#39360147)
Trying it now. Doesn't seem censored to me.
[ Parent | on HN ]
Re:Nvidia's Chat with RTX is a promising AI chatbot that run... by dvngnt_ on Tuesday February 13, 2024 @10:53AM (#39358766)
it uses Mistral or Llama 2
[ Parent | on HN ]
Re:Nvidia's Chat with RTX is a promising AI chatbot that run... by Const-me on Tuesday February 13, 2024 @01:41PM (#39361122)
You could try my Mistral implementation: https://github.com/Const-me/Cgml/blob/master/Mistral/Mistral...
[ Parent | on HN ]