Re:Solving the out-of-context chunk problem for RAG
by zmccormick7 on Thursday July 25, 2024 @11:08AM
(#41069576)
Agreed that thresholds don't work when applied to the cosine similarity of embeddings. But I have found that the similarity score returned by high-quality rerankers, especially Cohere, are consistent and meaningful enough that using a threshold works well there.
[ Parent
| on HN ]