News for hackers. Stuff that matters.
Re:Deep Learning at x.ai by cjauvin on Friday March 25, 2016 @11:21AM (#11360526)
word2vec is an algorithm to produce meaningful "word embeddings", which is a vector representation in a usually high-dimensional space. t-SNE is a dimensionality-reduction algorithm. Both can be used together, as they serve different purposes.
Re:Deep Learning at x.ai by jknz on Friday March 25, 2016 @11:25AM (#11360569)
One could argue that Word embeddings are also dimensionality-reduction techniques: Words live in an infinite dimensional space, and the embeddings is a finite-dimensional projection of this infinte dimensional space.
Re:Deep Learning at x.ai by mrdrozdov on Friday March 25, 2016 @12:05PM (#11360835)
I think of word vectors in the opposite light. Words stored in a dictionary have 1-dimension (their index), making comparisons more or less random. Word vectors augment the information you have about a word by continually examining the context that the word appears in a corpus of text.
Re:Deep Learning at x.ai by josh11b on Friday March 25, 2016 @12:00PM (#11360805)
In fact, the typical way to visualize word2vec embeddings is t-SNE.