News for hackers. Stuff that matters.
Re:I want flexible queries, not RAG by magicalhippo on Tuesday May 21, 2024 @08:22PM (#40435957)
> It lets them retrieve documents or document fragments that do not contain the terms in the search query, but that are conceptually similar (according to the encoder used).

I played with Latent Semantic Indexing[1] as a teen back in early 2000s, which also does kinda that. I haven't read much on RAG, I'm assuming it's some next level stuff, but are there any relations or similarities?

[1]: https://en.wikipedia.org/wiki/Latent_semantic_analysis#Laten...

Re:I want flexible queries, not RAG by kergonath on Wednesday May 22, 2024 @01:28AM (#40437619)
It is similar to the retrieval stage, yes. The concept of RAG is to then feed the retrieved fragments to a model so it can generate an answer that takes them into account.