News for hackers. Stuff that matters.
Re:Vanna.ai: Chat with your SQL database by spencerchubb on Sunday January 14, 2024 @05:16PM (#38994972)
I'm pretty sure whoever coined the term just wanted to sound smart. Retrieval Augmented Generation is a fancy way to say "put data in the prompt"
Re:Vanna.ai: Chat with your SQL database by hliyan on Sunday January 14, 2024 @11:11PM (#38997366)
Or rather, run a cosine similarity search on a large data set that won't fit in the prompt, find only the bits that are relevant to the query, and put that in the prompt.