An alternative to Elasticsearch that runs on a few MBs of RAM

Re:An alternative to Elasticsearch that runs on a few MBs of... by keyle on Monday October 24, 2022 @08:43AM (#33315923)

Yeah there needs to be some kind of acid test that will compare these products on equal footing and show the pitfalls.

[ Parent | on HN ]

Re:An alternative to Elasticsearch that runs on a few MBs of... by sanxiyn on Monday October 24, 2022 @09:02AM (#33316080)

This is very very difficult, but Tantivy tried: see https://github.com/quickwit-oss/search-benchmark-game

[ Parent | on HN ]

Re:An alternative to Elasticsearch that runs on a few MBs of... by jasfi on Monday October 24, 2022 @10:56AM (#33317513)

That would be great. However if you wanted to benchmark relevance ranking, how would you do that?

[ Parent | on HN ]

Re:An alternative to Elasticsearch that runs on a few MBs of... by sanxiyn on Monday October 24, 2022 @11:19AM (#33317853)

You need a dataset and an evaluation metric. The usual evaluation metric is NDCG(Normalized Discounted Cumulative Gain): https://en.wikipedia.org/wiki/NDCG

An example dataset is BEIR(BEnchmarking Information Retrieval), published in NIPS 2021: https://github.com/beir-cellar/beir

[ Parent | on HN ]

Re:An alternative to Elasticsearch that runs on a few MBs of... by DeathArrow on Monday October 24, 2022 @03:47PM (#33321590)

Here is a performance benchmark: https://db-benchmarks.com/test-hn/#manticore-search-columnar...

[ Parent | on HN ]