Re:ANN v3: 200ms p99 query latency over 100B vectors
by alanwli on Sunday January 25, 2026 @01:24PM
(#46756624)
Out of curiosity, how is the 92% recall calculated? For a given query, is the recall compared to the true topk of all 100B vectors vs. recall at each of N shards compared to the topk of each respective shard?
[ Parent
| on HN ]
Re:ANN v3: 200ms p99 query latency over 100B vectors
by nvanbenschoten on Sunday January 25, 2026 @01:45PM
(#46756858)
(author here) The 92% mentioned in this post is showing recall@10 across all 100B vectors, calculated by comparing to the global top_k.
turbopuffer will also continuously monitor production recall at the per-shard level (or on-demand with https://turbopuffer.com/docs/recall). Perhaps counterintuitively, the global recall will actually be better than the per-shard recall if each shard is asked for its own, local top_k!