Re:Find anything fast with Google's vector search technology
by jkb79 on Wednesday December 15, 2021 @03:38AM
(#29563403)
>then possibly combine search results with keyword based search (say BM25) to >improve accuracy etc. I am still waiting to see an end-to-end API doing all this
>
Vespa.ai supports combining dense vector search with keyword search and ranking, see https://docs.google.com/presentation/d/1vWKhSvFH-4MFcs4aNa9C...
There is also a Vespa sample application (open source, Apache 2) demonstrating multiple different retrieval and ranking strategies over at https://github.com/vespa-engine/sample-apps/blob/master/msma...
Re:Find anything fast with Google's vector search technology
by thirdtrigger on Wednesday December 15, 2021 @12:53AM
(#29562580)
> I am still waiting to see an end to end API doing all this
That’s kinda the idea of Weaviate. You might like the Wikipedia demo dataset that contains all this. You indeed need to run this demo on your own infra but the whole setup (from vector DB to ML models) is containerized https://github.com/semi-technologies/semantic-search-through...
Re:Find anything fast with Google's vector search technology
by dontreact on Tuesday December 14, 2021 @05:42PM
(#29559134)
Interesting. Did you also tackle the incremental update problem with FAISS?
Re:Find anything fast with Google's vector search technology
by leobg on Wednesday December 15, 2021 @04:16AM
(#29563652)
hnswlib[1] allows for incremental updates. And I believe in terms of accuracy it stacks up fairly well against alternatives like FAISS or ScaNN.
Re:Find anything fast with Google's vector search technology
by freediver on Tuesday December 14, 2021 @05:43PM
(#29559150)
No, I didn't have a need for it in this demo (but is certainly possible with Faiss).
Re:Find anything fast with Google's vector search technology
by dontreact on Tuesday December 14, 2021 @08:49PM
(#29561036)
Thanks for sharing all that you have so far. I’d be super curious to learn more about how to best do incremental updates with FAISS!
Re:Find anything fast with Google's vector search technology
by pierrefermat1 on Tuesday December 14, 2021 @11:29PM
(#29562101)
Likewise here, had a look around on the Weaviate website too and couldn't find much on how they are internally handling incremental updates
Re:Find anything fast with Google's vector search technology
by thirdtrigger on Wednesday December 15, 2021 @12:56AM
(#29562595)
Did you see this blog? https://db-engines.com/en/blog_post/87
It's an interesting point tho. Maybe it's good to add this to the docs as well
Anyway, for me, the number one priority was latency and it is hard to beat on-premise search for that.
Even then, a vector search API is just one component you will need in your stack. You need to pick the right model, create vectors (GPU intensive), then possibly combine search results with keyword based search (say BM25) to improve accuracy etc. I am still waiting to see an end-to-end API doing all this.