Re:Understanding word vectors
by wodenokoto on Saturday March 03, 2018 @02:06AM
(#16508283)
I meant for generating wordvectors.
Word2vec and fasttext use nn that are so shallow that the can be described as types of linear regression.
CNNs and RNNs would be used in the next stage of the pipeline for whatever your task is (machine translation etc), probably as some way of combining the word vectors. RNNs are especially nice as they can deal with variable length sentences. Note also that it's possible for systems to learn their own systems as part of training, rather than using pre-trained ones from word2vec etc.