News for hackers. Stuff that matters.

A comment on Show HN: Sense2vec model trained on all 2015 Reddit comments. Parent comment

Re:Show HN: Sense2vec model trained on all 2015 Reddit comments by syllogism on Monday February 15, 2016 @06:21PM (#11106827)
This is supported in the underlying data, but we don't expose it in the UI at the moment. We'll probably do something a bit different to help people make those queries.
[ Parent | on HN ]
Re:Show HN: Sense2vec model trained on all 2015 Reddit comments by j2kun on Monday February 15, 2016 @10:05PM (#11107656)
Would it be possible for you to make the trained vectors available for download and independent analysis without having to rescrape and retrain the model?
[ Parent | on HN ]
Re:Show HN: Sense2vec model trained on all 2015 Reddit comments by henningpeters on Tuesday February 16, 2016 @02:45AM (#11108434)
Maybe it wasn't clear, but we open-sourced everything, including the trained model. See here:

https://github.com/spacy-io/sense2vec

For installation:

$ pip install -e git+git://github.com/spacy-io/sense2vec.git#egg=sense2vec

$ python -m sense2vec.download

This downloads and installs the sense2vec package and model we used in the demo.

We are currently working on finishing the PyPI package. Meanwhile only Linux is supported and the docs are pretty much non-existing. Also, please make sure you have a recent Blas/Atlas package installed (RedHat: atlas, atlas-devel)

Direct link to the model file (~600MB):

https://index.spacy.io/models/reddit_vectors-1.0.1/archive.g...

[ Parent | on HN ]
Re:Show HN: Sense2vec model trained on all 2015 Reddit comments by MasterScrat on Tuesday February 16, 2016 @02:25AM (#11108391)
FYI there are Reddit data dumps publicly available, no need to kill Reddit scraping it:

https://archive.org/details/2015_reddit_comments_corpus

[ Parent | on HN ]
Re:Show HN: Sense2vec model trained on all 2015 Reddit comments by tartakovsky on Tuesday February 16, 2016 @02:52AM (#11108452)
Awesome.
[ Parent | on HN ]