Re:Ask HN: Is RAG the Future of LLMs?
by verdverm on Sunday April 14, 2024 @07:21PM
(#40035408)
There's also the focus. A long context means the LLM is more easily distracted. Context "gets the right neurons firing" and why RAG does well. It's also why reranking with RAG improves output, in further increases the quality and/or relevance into a smaller context.
Which is all to say really, data quality is probably the most distinguishing factor in LLM/RAG systems... to get back to OP's questions
Which is all to say really, data quality is probably the most distinguishing factor in LLM/RAG systems... to get back to OP's questions