Re:I want flexible queries, not RAG
by ozr on Tuesday May 21, 2024 @10:23PM
(#40436728)
That's not what RAG is. RAG is the process of adding relevant information to a prompt in an LLM. It's a form of in-context learning.
[ Parent
| on HN ]
It’s right there in the name - first you Retrieve relevant information (often a vector lookup) then you use it to Augment the prompt, then you Generate an answer.
It’s bloody useful if you can’t cram your entire proprietary code base into a prompt.
What makes it useful is precisely that it is not learning.
Yes it is; it's just not updating the weights.