Re:Show HN: Sense2vec model trained on all 2015 Reddit comments
by MasterScrat on Monday February 15, 2016 @06:16PM
(#11106804)
Now can't you experiment with algebra operations on those vectors, like "queen minus female plus male = king"?
[ Parent
| on HN ]
Re:Show HN: Sense2vec model trained on all 2015 Reddit comments
by syllogism on Monday February 15, 2016 @06:21PM
(#11106827)
This is supported in the underlying data, but we don't expose it in the UI at the moment. We'll probably do something a bit different to help people make those queries.
Re:Show HN: Sense2vec model trained on all 2015 Reddit comments
by j2kun on Monday February 15, 2016 @10:05PM
(#11107656)
Would it be possible for you to make the trained vectors available for download and independent analysis without having to rescrape and retrain the model?
Re:Show HN: Sense2vec model trained on all 2015 Reddit comments
by henningpeters on Tuesday February 16, 2016 @02:45AM
(#11108434)
Maybe it wasn't clear, but we open-sourced everything, including the trained model. See here:
https://github.com/spacy-io/sense2vec
For installation:
$ pip install -e git+git://github.com/spacy-io/sense2vec.git#egg=sense2vec
$ python -m sense2vec.download
This downloads and installs the sense2vec package and model we used in the demo.
We are currently working on finishing the PyPI package. Meanwhile only Linux is supported and the docs are pretty much non-existing. Also, please make sure you have a recent Blas/Atlas package installed (RedHat: atlas, atlas-devel)
Direct link to the model file (~600MB):
https://index.spacy.io/models/reddit_vectors-1.0.1/archive.g...
Re:Show HN: Sense2vec model trained on all 2015 Reddit comments
by MasterScrat on Tuesday February 16, 2016 @02:25AM
(#11108391)
FYI there are Reddit data dumps publicly available, no need to kill Reddit scraping it:
Re:Show HN: Sense2vec model trained on all 2015 Reddit comments
by tartakovsky on Tuesday February 16, 2016 @02:52AM
(#11108452)
Awesome.