Re:Systematically Improving Your RAG
by Xenoamorphous on Thursday May 23, 2024 @04:52PM
(#40459758)
Is that RAG though? Perhaps I’m missing something but I don’t see where the retrieval step is. Extracting the metadata and passing it to the LLM in the context sounds like a non-RAG LLM application. Or you’re saying that the DB schema is so big and/or the LLM context too small so not all the metadata can be passed in one go and there’s some search step to prune the number of tables?
[ Parent
| on HN ]
RAG is augmenting the llm generation with external data. How the external data is retrieved is irrelevant. A search is not necessary.
Of course you can do a search on the related tables with regard to the question to narrow down the table list to help the llm to come up with the correct answer.