Word vectors are awesome but you don’t need a neural network to find them

Re:Word vectors are awesome but you don’t need a neural netw... by serveboy on Wednesday October 18, 2017 @08:32PM (#15504525)

word2vec yields better representations than PMI-SVD. If you want a better explicit PMI matrix factorization, have a look at https://github.com/alexandres/lexvec and the original paper. Explains why SVD performs poorly.

If you are looking for word embedding for production use, checkout fasttext, lexvec, glove, or word2vec. Don't use the approach described in this article.

[ Parent | on HN ]

Re:Word vectors are awesome but you don’t need a neural netw... by serveboy on Wednesday October 18, 2017 @08:37PM (#15504538)

Pass the "-matrix pmi" flag to factor the PMI matrix as by default it factorizes PPMI.

[ Parent | on HN ]