Re:Do we think about vector dbs wrong?
by osigurdson on Tuesday September 05, 2023 @09:11AM
(#37391136)
An OpenAI embeddings vector is 1536 4 byte floats. 1 TiB is roughly 174K such embeddings vectors.
[ Parent
| on HN ]
Re:Do we think about vector dbs wrong?
by brigadier132 on Tuesday September 05, 2023 @10:02AM
(#37391759)
Your math is wrong. 100k 32 bit vectors is 600mb
I think your point is right though. Searching through these is requires an index of some sort at any reasonable scale (not google scale).
Re:Do we think about vector dbs wrong?
by osigurdson on Tuesday September 05, 2023 @10:46AM
(#37392382)
Hmmm, yeah, I used 2^30 instead of 2^40. Should not comment before caffeinating.