News for hackers. Stuff that matters.
Re:Vector database that can index 1B vectors in 48M by adastra22 on Friday September 12, 2025 @05:35PM (#45227038)
1B x 4096 = 4T scalars.

That doesn't fit in anyone's video ram.

Re:Vector database that can index 1B vectors in 48M by kingstnap on Friday September 12, 2025 @09:07PM (#45228426)
Well we have AI GPUs now so you could do it.

Each MI325x has 256 GB of HBM. So you would need ~32 of em if it was 2 bytes per scalar.