That's true and we have tried different configurations for systems that use HNSW. But for the ease of presentation, we only choose the configuration with the highest throughput at precision 98%.
Here is a figure in our open-source benchmark framework repo that shows other configurations that we have tested: https://github.com/myscale/vector-db-benchmark/blob/master/i...
A note on benchmarks with HNSW is that you need to optimize your ‘m’ and ‘ef_construction’ params at index time and your ef_search param at query time.
So you may not be getting an optimized result from DBs like Qdrant and weaviate.