Re:Is Cosine-Similarity of Embeddings Really About Similarity?
by mo_42 on Tuesday March 12, 2024 @02:05AM
(#39676633)
Only if those two words appear in the same contexts with the same frequency. In natural language this is probably not the case. There are things typically considered beautiful and others as ugly.
[ Parent
| on HN ]
Re:Is Cosine-Similarity of Embeddings Really About Similarity?
by singularity2001 on Tuesday March 12, 2024 @04:24AM
(#39677285)
one key insights is that opposites do have a lot in common, they are often opposites in exactly one of n feature dimensions. For example black and white are both (arguably) colors, are related to (lack of) light, have representations in various formats (RGB, …), appear in the same grammatical position of ordered adjectives …