News for hackers. Stuff that matters.
Re:Word embeddings in 2017: Trends and future directions by serveboy on Saturday October 21, 2017 @04:19PM (#15523418)
https://github.com/kudkudak/word-embeddings-benchmarks has a pretty nice evaluation of existing embedding methods. Notably missing from this article is GloVe ( https://nlp.stanford.edu/projects/glove/) and LexVec ( https://github.com/alexandres/lexvec ) both which tend to outperform word2vec in both intrinsic and extrinsic tasks. Also of interest are methods which perform retrofitting, improving already trained embeddings. Morph fitting (ACL 2017) is a good example. Hashimoto et al (2016) sheds some interesting insight on how embeddings methods are performing metric recovery. Lots of exciting stuff in this area.
Re:Word embeddings in 2017: Trends and future directions by serveboy on Saturday October 21, 2017 @04:27PM (#15523462)
Alex Gittens also has a nice paper this year showing how Skipgram enables vector additivity. See http://www.aclweb.org/anthology/P17-1007