Re:Find anything fast with Google's vector search technology
by pierrefermat1 on Tuesday December 14, 2021 @11:34PM
(#29562130)
We are only talking about backend performance so I don't really think it's fair to include network latency on this metric, it can also hugely varied based on your current network/location setup
Re:Find anything fast with Google's vector search technology
by freediver on Tuesday December 14, 2021 @11:58PM
(#29562277)
> For low-latency (up to couple of hundred milliseconds) use cases, it is highly unlikely that any cloud solution like this would be a better choice than something deployed on premise because of the *network overhead*.
I was obviously talking about a general use case where a user considers using an API like this vs running Faiss, and their server can be anywhere (a use case that is more common to me personally).