Re:Find anything fast with Google's vector search technology
by freediver on Tuesday December 14, 2021 @04:51PM
(#29558441)
With the caveat of having to use GCP to host your server too, I can agree with you (although 5ms still sounds incredibly low, how many vectors was that?).
I was obviously talking about a general use case where a user considers using an API like this vs running Faiss, and their server can be anywhere (a use case that is more common to me personally).
Re:Find anything fast with Google's vector search technology
by pierrefermat1 on Tuesday December 14, 2021 @11:34PM
(#29562130)
We are only talking about backend performance so I don't really think it's fair to include network latency on this metric, it can also hugely varied based on your current network/location setup
Re:Find anything fast with Google's vector search technology
by freediver on Tuesday December 14, 2021 @11:58PM
(#29562277)
> For low-latency (up to couple of hundred milliseconds) use cases, it is highly unlikely that any cloud solution like this would be a better choice than something deployed on premise because of the *network overhead*.
The offering is similarity search, not a search engine. They offer image to image as another comparison point.