Re:Word vectors are awesome but you don’t need a neural netw...
by make3 on Wednesday October 18, 2017 @07:33PM
(#15504220)
the embedding layer is the layer that converts the one hot word feature in to a continuous multi dimensional vector that the deep net can learn with.
they used to pretrain that layer separately with word2vec. now as it's just a neural net layer, they let the translation model train it with backprop on the main (translation /dialog / qa, etc) task as a regular layer
[ Parent
| on HN ]
There are no comments on this comment yet.