Natural language benchmarks don’t measure AI models’ general knowledge well

Re:Natural language benchmarks don’t measure AI models’ gene... by maximedb on Monday August 24, 2020 @05:21AM (#24258833)

Did you also try with "retrieval" models models such as RAG, REALM, etc ?

[ Parent | on HN ]

Re:Natural language benchmarks don’t measure AI models’ gene... by patrick-lewis on Monday August 24, 2020 @07:54AM (#24259748)

Hi, first author here. Yes, we evaluated 3 retrieval-based models, DPR, RAG and FID - check out the paper for the numbers (https://arxiv.org/pdf/2008.02637.pdf)

[ Parent | on HN ]