News for hackers. Stuff that matters.
Re:Solving the out-of-context chunk problem for RAG by ianbutler on Saturday July 27, 2024 @12:25AM (#41084457)
It was in consideration of how slow our FTS at the time was over large amount of documents and the window we wanted to keep response times in and you're correct, we had custom embeddings and we had a reasonably high confidence.

So vector search would reduce the space to like 10k documents and then we'd take the document ids and FTS acted as the final authority on the ranking.

There are no comments on this comment yet.