News for hackers. Stuff that matters.

A comment on An alternative to Elasticsearch that runs on a few MBs of RAM. Parent comment

Re:An alternative to Elasticsearch that runs on a few MBs of... by jasfi on Monday October 24, 2022 @10:56AM (#33317513)
That would be great. However if you wanted to benchmark relevance ranking, how would you do that?
[ Parent | on HN ]
Re:An alternative to Elasticsearch that runs on a few MBs of... by sanxiyn on Monday October 24, 2022 @11:19AM (#33317853)
You need a dataset and an evaluation metric. The usual evaluation metric is NDCG(Normalized Discounted Cumulative Gain): https://en.wikipedia.org/wiki/NDCG

An example dataset is BEIR(BEnchmarking Information Retrieval), published in NIPS 2021: https://github.com/beir-cellar/beir

[ Parent | on HN ]