News for hackers. Stuff that matters.

A comment on Dot: use of local LLMs and RAG in particular to interact with documents. Parent comment

Re:Dot: use of local LLMs and RAG in particular to interact ... by boredemployee on Sunday April 07, 2024 @06:31AM (#39959826)
I think it depends of what they want. Like a search is indeed an easy solution, but if they want a summarization or a generated, straight answer so then things get a little bit harder.
[ Parent | on HN ]
Re:Dot: use of local LLMs and RAG in particular to interact ... by cyanydeez on Monday April 08, 2024 @04:13PM (#39973237)
A solution that combines RAG and function calling could span the correct depth, but yeah, the context depth is what will determine usefulness for user interaction.
[ Parent | on HN ]