News for hackers. Stuff that matters.
Re:What Is Retrieval-Augmented Generation a.k.a. RAG? by filterfiber on Friday December 01, 2023 @04:45PM (#38492905)
I have to agree, RAG is effectively just compensating for data not fitting in the context window, and it has (potentially severe) limitations.

Summarizing a book I think is a great example, RAG prevents LLMs from correlating all of the data.

It will likely never be obsolete, but a larger context would be far preferable in nearly all scenerios.

There are no comments on this comment yet.