Re:Find anything fast with Google's vector search technology
by dontreact on Tuesday December 14, 2021 @05:42PM
(#29559134)
Interesting. Did you also tackle the incremental update problem with FAISS?
[ Parent
| on HN ]
Re:Find anything fast with Google's vector search technology
by leobg on Wednesday December 15, 2021 @04:16AM
(#29563652)
hnswlib[1] allows for incremental updates. And I believe in terms of accuracy it stacks up fairly well against alternatives like FAISS or ScaNN.
Re:Find anything fast with Google's vector search technology
by freediver on Tuesday December 14, 2021 @05:43PM
(#29559150)
No, I didn't have a need for it in this demo (but is certainly possible with Faiss).
Re:Find anything fast with Google's vector search technology
by dontreact on Tuesday December 14, 2021 @08:49PM
(#29561036)
Thanks for sharing all that you have so far. I’d be super curious to learn more about how to best do incremental updates with FAISS!
Re:Find anything fast with Google's vector search technology
by pierrefermat1 on Tuesday December 14, 2021 @11:29PM
(#29562101)
Likewise here, had a look around on the Weaviate website too and couldn't find much on how they are internally handling incremental updates
Re:Find anything fast with Google's vector search technology
by thirdtrigger on Wednesday December 15, 2021 @12:56AM
(#29562595)
Did you see this blog? https://db-engines.com/en/blog_post/87
It's an interesting point tho. Maybe it's good to add this to the docs as well