News for hackers. Stuff that matters.
Re:ScaNN: Efficient Vector Similarity Search by contravariant on Thursday July 30, 2020 @06:44AM (#23996625)
In case anyone else was confused why they didn't just project onto q first if they want to have <q,x'> as close as possible to the original <q,x>. Apparently q is a random query vector and their research shows how to define an alternative quantization loss where you weigh quantization loss more heavily when |<q,x>| is high [1].

It's worth noting that without this additional weighting you end up with the euclidean distance under the assumption that q is distributed symmetrically.

[1]: https://arxiv.org/abs/1908.10396

There are no comments on this comment yet.