News for hackers. Stuff that matters.
Re:Understanding BERT and Search Relevance (2019) by charlescearl on Wednesday April 22, 2020 @01:18PM (#22947905)
I've glanced at an approach augments an existing document by adding likely search terms generated by BERT model specialized for Q&A

https://cs.uwaterloo.ca/~jimmylin/publications/Nogueira_Lin_...

Do you have any thoughts on this or similar approaches in production?

Re:Understanding BERT and Search Relevance (2019) by binarymax on Wednesday April 22, 2020 @02:24PM (#22948603)
I'm really interested in this general area of generating good candidate queries from documents, but haven't spent much time on it. I haven't seen it in production, and I don't think the topic gets as much attention as it should because intuitively it sounds like a really good idea, so thanks for the paper!

Results for R@1000 look pretty impressive, and I'll check out the project code. Given the high recall and low MRR, using this for the initial recall step with a rerank is definitely worth looking at. if the high recall carries over to your own data and you can rerank those top 1k to increase precision, then you've got something good.