There is no secret about the benchmark, its all open source: https://github.com/wolfgarbe/LuceneBench

It seems you tried MMapDirectory and then commented it out. https://github.com/wolfgarbe/LuceneBench/blob/master/LuceneB...

So, you may be hitting SimpleFSDirectory instead, which does have issues with too many searches.

Could you share the reasons, MMapDirectory did not work for you?

"NIOFSDirectory and MMapDirectory implementations face file-channel issues in Windows and memory release problems respectively. To overcome such environment peculiarities Lucene provides the FSDirectory.open() method. When invoked, it tries to choose the best implementation depending on the environment." https://www.baeldung.com/lucene-file-search

Right. I found you are running on Windows after posting the comment. Makes sense, though there were some fixes in the latest Lucene I believe.

The Lucene's own benchmarks are at: https://home.apache.org/~mikemccand/lucenebench/ , though I admit to not know enough about benchmarking to form a strong opinion.

Either way, good luck with the project/service. More competition is always great. The open-source components look interesting too.

The way I understand it is that it crashes when 4 concurrent users are running the benchmark. Which could make sense if it’s a stress-test.