Re:Show HN: Demystifying Advanced RAG Pipelines
by SubiculumCode on Saturday October 28, 2023 @12:23PM
(#38051009)
As a researcher I've been interested in developing a RAG pipeline populated with research articles on my topic of study. Does it fit easily in the RAG approach to also return excerpts from the actual documents as to help me verify, at a glance the source and veracity of LLM outputs?
[ Parent
| on HN ]
Re:Show HN: Demystifying Advanced RAG Pipelines
by tayo42 on Saturday October 28, 2023 @12:35PM
(#38051153)
You can do the summarization part how ever you want. You don't even need have an llm summarize what the program found. The context that includes the answer, so you can just include that in your final response.
Re:Show HN: Demystifying Advanced RAG Pipelines
by pchunduri6 on Saturday October 28, 2023 @12:56PM
(#38051394)
Yes, this is an excellent RAG use-case! The vector index that I use in the repository using EvaDB [1] to retrieve the top-K matches to the user queries from the available data sources. So, you can manually inspect the best matches to your query from the research article and verify the correctness of the LLM responses.