Re:Demystifying Word2Vec
by stared on Tuesday February 07, 2017 @02:23PM
(#13591859)
word2vec is a naive technique, which relies only on the colocation of words. Yes, it misses many things - word order, grammar (e.g. negations), words with many distinct meanings (lead (Pb) vs (to) lead), synonyms vs antonyms etc.
What's interesting is that it works at all. My blog post on that: http://p.migdal.pl/2017/01/06/king-man-woman-queen-why.html