Re:Reddit can't build a better search engine
by Der_Einzige on Thursday February 17, 2022 @02:35AM
(#30370473)
Yeah, having spent a lot of time working with dense vector based techniques, especially in the context of a domain which is really similar to semantic search, I can say 100% that I don't want BERT and related techniques anywhere near my google search. That's the real crux of the problem, is the reliance on these sorts of models, and their utilization within query rewriting schemes.
The reliance on synonyms and semantically related topics has made iterative refining impossible as well, it's essentially non-converging.
My solution has been to search in multiple foreign languages, which looks less conducive to these "affordances".