News for hackers. Stuff that matters.
Re:Understanding word vectors by aglionby on Friday March 02, 2018 @02:54PM (#16505074)
Yes, I've not looked at fasttext but word2vec is a simple 1 hidden-layer network to learn word embeddings, which can then be used as pre-trained word embeddings in other tasks.

CNNs and RNNs would be used in the next stage of the pipeline for whatever your task is (machine translation etc), probably as some way of combining the word vectors. RNNs are especially nice as they can deal with variable length sentences. Note also that it's possible for systems to learn their own systems as part of training, rather than using pre-trained ones from word2vec etc.

Re:Understanding word vectors by wodenokoto on Saturday March 03, 2018 @02:06AM (#16508283)
I meant for generating wordvectors.

Word2vec and fasttext use nn that are so shallow that the can be described as types of linear regression.