70M vectors searched in 48ms on a single consumer GPU –results you won't believe
I built a prototype GPU-based vector search system that runs locally on a consumer PC.Hardware:RTX 3090 consumer CPU NVMe SSDDataset:~70 million vectors (384 dimensions)Performance:~48 ms search latency for top-k results.This corresponds to roughly ~1.45 billion vector comparisons per second on a single GPU.The system uses a custom GPU kernel and a two-stage search pipeline (binary filtering +...