News for hackers. Stuff that matters.

A comment on Dot: use of local LLMs and RAG in particular to interact with documents. Parent comment

Re:Dot: use of local LLMs and RAG in particular to interact ... by HeavyStorm on Sunday April 07, 2024 @07:10AM (#39960010)
The LLM would have to be trained on the local data. Not impossible, but maybe too costly?
[ Parent | on HN ]
Re:Dot: use of local LLMs and RAG in particular to interact ... by snowfield on Sunday April 07, 2024 @10:01AM (#39960825)
It sounds nice in theory but your dataset is most likely too small for the LLM to "learn" anything.
[ Parent | on HN ]