News for hackers. Stuff that matters.
Re:A new semantic chunking approach for RAG by extr on Wednesday September 25, 2024 @12:50AM (#41643794)
Very cool! I'm wondering how to apply it to the type of RAG problems I usually encounter which are more technical in nature. Specification A refers to Specification C which has references to X, Y, and Z, but only X is really important context. You can traverse the tree, but how to select the important nodes? Semantic similarity is not appropriate since the specifications refer to different components of a system and are not semantically similar at all.

There are no comments on this comment yet.