Re:Understanding word vectors
by aglionby on Friday March 02, 2018 @02:45PM
(#16504962)
Combining word embeddings to get a single representation of a sentence in general is a pretty hard problem. Point-wise averaging, addition or summation [0] works alright, but it's not great. Some more recent work looks a using RNNs to combine them; most of the literature I've seen is pretty application-specific, but try [1][2] for flavour.
[0] http://www.aclweb.org/anthology/P/P08/P08-1028
[1] http://arxiv.org/abs/1409.3215
[2] http://arxiv.org/abs/1409.0473