Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on Show HN: Word2vec Algorithm in ~100sloc with NumPy. Parent comment
With a high dimension vector (>50d, more usually 300d or 500d) one or two dimensions together will pick up a concept.
This is why word algebra like
Paris - France + Russia ~ Moscow
works with original Word2Vec vectors.
Language models are better at picking up context-dependent meaning, but word vectors still have good enough performance for many tasks.
There are no comments on this comment yet.
With a high dimension vector (>50d, more usually 300d or 500d) one or two dimensions together will pick up a concept.
This is why word algebra like
Paris - France + Russia ~ Moscow
works with original Word2Vec vectors.
Language models are better at picking up context-dependent meaning, but word vectors still have good enough performance for many tasks.