News for hackers. Stuff that matters.
Re:Language Models, Word2Vec, and Efficient Softmax Approxim... by oelmekki on Sunday October 29, 2017 @10:38AM (#15579465)
Alternatively to tf-idf, there's an interesting property in word embeddings generated by word2vec : they're sorted by rarity (the most common words being on top of the list).

So if you insert them in the same order in a database, you can just use their primary key as weight for a word. This also has the advantage of filtering out stop words without any additional processing.

There are no comments on this comment yet.