Ask HN: What do you use local LLMs for?

Re:Ask HN: What do you use local LLMs for? by thedangler on Wednesday May 08, 2024 @02:54PM (#40301663)

I'm looking to implement a local RAG for my business to read, pdfs, spreadsheets, FAQ, and scan parent company websites.

Not sure where to start but people projects here are giving me a good direction.

Eventually I'd want the chat on my business site to start a sale process.

[ Parent | on HN ]

Re:Ask HN: What do you use local LLMs for? by juanfrank77 on Thursday May 09, 2024 @04:34PM (#40312694)

You can start by defining the scope and the tools you want to use.

Both coding or nocode tools can help. The simplest option would be to take one of those "privacy-friendly" options out there for a spin on a free tier and as you work you'll see what limitations you encounter or features you'd want.

And then you can customize it further using coding tools.

[ Parent | on HN ]