Re:Is Cosine-Similarity of Embeddings Really About Similarity?
by soarerz on Wednesday March 13, 2024 @10:07AM
(#39691366)
This is effectively "the same" as dot product.
For a lot of embeddings we have today, norm of any embedding vector is roughly of same size, so the angle between two vectors is roughly same size as length of difference that you are saying, and can be expressed in terms of 1 - dot product after scaling
For a lot of embeddings we have today, norm of any embedding vector is roughly of same size, so the angle between two vectors is roughly same size as length of difference that you are saying, and can be expressed in terms of 1 - dot product after scaling