Re:Rag Is a Hack
by jamesbriggs on Saturday October 07, 2023 @04:36AM
(#37800065)
Yeah RAG has been around for some time, paper [2] being where I first stumbled onto it — I remember a 2-3 years ago building a RAG pipeline using either the model they trained in paper 2, or that was trained based on the same idea, with Deepset AI's Haystack library. It has been a little surreal to see that terminology become so popular again
But better answer: "retrieval augmented" has been used in papers since at least 2018 [1], the full "RAG" acronym since at least 2020 [2], and everyone in the GPT3+ hype wave caught up to it once they realized they were doing the same thing.
[1] https://arxiv.org/abs/1808.03430 [2] https://arxiv.org/abs/2005.11401