Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on 70M vectors searched in 48ms on a single consumer GPU –results you won't believe.
At this point it feels like the bottleneck is less about raw compute and more about how efficiently data is represented and accessed on the GPU.
Curious if others have seen similar behavior when pushing large-scale vector search on consumer hardware.
There are no comments on this comment yet.
At this point it feels like the bottleneck is less about raw compute and more about how efficiently data is represented and accessed on the GPU.
Curious if others have seen similar behavior when pushing large-scale vector search on consumer hardware.