News for hackers. Stuff that matters.
Re:The Best Machine Learning, NLP, and Python Tutorials I’ve... by agumonkey on Tuesday June 27, 2017 @05:15PM (#14649515)
How far can you go in spacy with the core 50MB english model ? the other parts are GB large.
Re:The Best Machine Learning, NLP, and Python Tutorials I’ve... by syllogism on Tuesday June 27, 2017 @05:28PM (#14649628)
The v2 models are much smaller (15mb), because neural networks. The parsing, NER and tagging are mostly okay with the 50mb model. There are only word vectors for the top 5k words though, which can be a problem.

The v2 English models are more accurate, and can assign vectors to any word, including unknown words using the context and the word shape. Overall it's much better -- but it's still in alpha. The docs are already better, though.