News for hackers. Stuff that matters.
Re:Do you need a vector database? by didip on Thursday April 13, 2023 @01:46PM (#35559265)
If you are doing LLM, of course you do. But an amazing OSS vector DB has yet to arrived. The number of vectors it could handle needs to be in the billions, at least.
Re:Do you need a vector database? by jessehu on Thursday April 13, 2023 @02:27PM (#35559897)
Re:Do you need a vector database? by rahimnathwani on Thursday April 13, 2023 @02:56PM (#35560355)
Doesn't a faiss index have to fit in memory?
Re:Do you need a vector database? by jkb79 on Thursday April 13, 2023 @05:02PM (#35562009)
Faiss implements multiple different ANN algorithms, and some like IVF can use disk based indexes.
Re:Do you need a vector database? by rahimnathwani on Thursday April 13, 2023 @05:10PM (#35562099)
Thanks. I just googled 'faiss ivf disk' and a couple of clicks later found this page: https://github.com/facebookresearch/faiss/wiki/Indexes-that-...