News for hackers. Stuff that matters.
Re:Find anything fast with Google's vector search technology by dontreact on Tuesday December 14, 2021 @05:42PM (#29559134)
Interesting. Did you also tackle the incremental update problem with FAISS?
Re:Find anything fast with Google's vector search technology by leobg on Wednesday December 15, 2021 @04:16AM (#29563652)
hnswlib[1] allows for incremental updates. And I believe in terms of accuracy it stacks up fairly well against alternatives like FAISS or ScaNN.

[1]: https://github.com/nmslib/hnswlib/

Re:Find anything fast with Google's vector search technology by freediver on Tuesday December 14, 2021 @05:43PM (#29559150)
No, I didn't have a need for it in this demo (but is certainly possible with Faiss).
Re:Find anything fast with Google's vector search technology by dontreact on Tuesday December 14, 2021 @08:49PM (#29561036)
Thanks for sharing all that you have so far. I’d be super curious to learn more about how to best do incremental updates with FAISS!
Re:Find anything fast with Google's vector search technology by pierrefermat1 on Tuesday December 14, 2021 @11:29PM (#29562101)
Likewise here, had a look around on the Weaviate website too and couldn't find much on how they are internally handling incremental updates
Re:Find anything fast with Google's vector search technology by thirdtrigger on Wednesday December 15, 2021 @12:56AM (#29562595)
Did you see this blog? https://db-engines.com/en/blog_post/87

It's an interesting point tho. Maybe it's good to add this to the docs as well