News for hackers. Stuff that matters.
Re:Find anything fast with Google's vector search technology by freediver on Tuesday December 14, 2021 @04:51PM (#29558441)
With the caveat of having to use GCP to host your server too, I can agree with you (although 5ms still sounds incredibly low, how many vectors was that?).

I was obviously talking about a general use case where a user considers using an API like this vs running Faiss, and their server can be anywhere (a use case that is more common to me personally).

Re:Find anything fast with Google's vector search technology by pierrefermat1 on Tuesday December 14, 2021 @11:34PM (#29562130)
We are only talking about backend performance so I don't really think it's fair to include network latency on this metric, it can also hugely varied based on your current network/location setup
Re:Find anything fast with Google's vector search technology by freediver on Tuesday December 14, 2021 @11:58PM (#29562277)
> For low-latency (up to couple of hundred milliseconds) use cases, it is highly unlikely that any cloud solution like this would be a better choice than something deployed on premise because of the *network overhead*.