Re:Dot: use of local LLMs and RAG in particular to interact ...
by logro on Sunday April 07, 2024 @08:12AM
(#39960219)
I have a reasonably wast library of technical/scientific epubs/documents. Could I use this to import them and the quiz the books?
[ Parent
| on HN ]
Re:Dot: use of local LLMs and RAG in particular to interact ...
by alexpinel on Sunday April 07, 2024 @02:30PM
(#39962683)
Yes! Of course because the LLM is running locally it is not as advanced as bigger models like Claude or GPT, but you can definately quiz the documents. From my experience it performs better with specific questions rather than more ambigous questions that require extensive understanding of the whole document.