News for hackers. Stuff that matters.

Ask HN: Suitable LLM models for an agent for user guides and docs?

Hi, i would like to implement an AI agent for my user guides and wiki (about 100 pages), so users can easily come in and interact with it. I expect the amount of content to increase quite a lot over time.

I would prefer it to the model to be self hosted, so I dont worry about how much APIs cost etc. My website content will be relatively small for a long time.

( 1 comment | on HN )
Re:Ask HN: Suitable LLM models for an agent for user guides ... by runjake on Thursday November 09, 2023 @11:52AM (#38207454)
Start playing with stuff like llama. You'll have to code it yourself.

https://sych.io/blog/how-to-run-llama-2-locally-a-guide-to-r...