Re:Is Cosine-Similarity of Embeddings Really About Similarity?
by vidarh on Tuesday March 12, 2024 @06:57AM
(#39678095)
From the introduction to the paper:
> Discrete entities are often embedded via a learned mapping to dense real-valued vectors in a variety of domains.
Already from that point, it is clear that a comparison based on the similarity of the textual version of the sentences is irrelevant to the evaluation in the paper. The paper consistently talk in terms of "learned embeddings" rather than simplistic direct mappings of words.
> Discrete entities are often embedded via a learned mapping to dense real-valued vectors in a variety of domains.
Already from that point, it is clear that a comparison based on the similarity of the textual version of the sentences is irrelevant to the evaluation in the paper. The paper consistently talk in terms of "learned embeddings" rather than simplistic direct mappings of words.