News for hackers. Stuff that matters.
Re:King – man + woman is queen; but why? by sp332 on Saturday January 07, 2017 @05:29PM (#13347031)
I thought it was putting words on the surface of a sphere and just doing math with cosine distance?
Re:King – man + woman is queen; but why? by stephencanon on Saturday January 07, 2017 @05:38PM (#13347085)
That's fine, but then you shouldn't pretend that you're in a vector space. Words have meanings, and mathematical concepts have precise definitions.
Re:King – man + woman is queen; but why? by sp332 on Saturday January 07, 2017 @05:41PM (#13347101)
Constraining points to a hypersphere surface only reduces dimensionality by one dimension. For example a sphere in 3-space still has a 2-dimensional surface to play with. That's still a vector space right?
Re:King – man + woman is queen; but why? by stephencanon on Saturday January 07, 2017 @05:53PM (#13347159)
No; it's not closed under linear combinations and it doesn't contain an additive identity.
Re:King – man + woman is queen; but why? by sp332 on Saturday January 07, 2017 @05:55PM (#13347167)
Well it does if you use the right coordinate system! As the article mentions, most people don't normalize correctly and only get passable answers by luck. You can add locations on the earth's surface if you pick a point to be the origin.