Re:Nearest neighbor indexes for similarity search
by rpedela on Thursday August 12, 2021 @06:04PM
(#28162160)
For my search use case, documents are mostly single topic and less than 10 pages. However I have found embeddings still work surprisingly well for longer documents with a few topics in them. But yes, multi-topic documents can certainly be an issue. Segmentation by sentence, paragraph, or page can help here. I believe there are ML-based topic segmentation algorithms too, but that certainly starts making it less simple.
[ Parent
| on HN ]
There are no comments on this comment yet.