Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on Vector database that can index 1B vectors in 48M. Parent comment
For 1024 dimensions even with 8 bit quantization you are looking at a terrabyte of data. Lets make it binary vectors, it is still 128GB of VRAM.
WAT?
There are no comments on this comment yet.
For 1024 dimensions even with 8 bit quantization you are looking at a terrabyte of data. Lets make it binary vectors, it is still 128GB of VRAM.
WAT?