Re:Do you need a vector database?
by didip on Thursday April 13, 2023 @01:46PM
(#35559265)
If you are doing LLM, of course you do. But an amazing OSS vector DB has yet to arrived. The number of vectors it could handle needs to be in the billions, at least.
[ Parent
| on HN ]
What’s wrong with Faiss? https://github.com/facebookresearch/faiss
Re:Do you need a vector database?
by rahimnathwani on Thursday April 13, 2023 @02:56PM
(#35560355)
Doesn't a faiss index have to fit in memory?
Faiss implements multiple different ANN algorithms, and some like IVF can use disk based indexes.
Re:Do you need a vector database?
by rahimnathwani on Thursday April 13, 2023 @05:10PM
(#35562099)
Thanks. I just googled 'faiss ivf disk' and a couple of clicks later found this page: https://github.com/facebookresearch/faiss/wiki/Indexes-that-...