News for hackers. Stuff that matters.
Re:Find anything fast with Google's vector search technology by rrdharan on Tuesday December 14, 2021 @06:08PM (#29559415)
> Hmm.. There is no web service that returns response in <5ms, unless you are sitting at the very terminal of the hardware producing the output.

Typical Google Cloud Bigtable P(50) is <= 4ms to a GCE VM in the same region.

Source: I work on Google Cloud Bigtable.

EDIT: I should clarify that applies to point reads on an established connection using gRPC-over-HTTP/2 from e.g. Java/golang/C++ client, and doesn’t include cold connection set-up / uncached auth / TLS negotiation, but those are well into P(99.999) territory if you’re doing millions of QPS (which applies to most of our large customers).

Re:Find anything fast with Google's vector search technology by rrdharan on Tuesday December 14, 2021 @06:19PM (#29559519)
Also pretty sure customers using hosted Redis / Memcached offerings like Google Cloud Memorystore or AWS Elasticache etc. get sub-1ms times for service-to-VM responses. Those aren’t over HTTP of course… so perhaps they don’t count as “web services”?
Re:Find anything fast with Google's vector search technology by freediver on Tuesday December 14, 2021 @06:33PM (#29559651)
I think you are talking about latency over the equipment in the same datacenter/intranet here which, yes, I do not count as web services but are more akin to 'sitting at the terminal'. If I could access Google Cloud Bigtable over the web from my home Mac at <5ms, that would of course be the biggest thing since the invention of the web :)