News for hackers. Stuff that matters.

A comment on How to solve most NLP problems: a step-by-step guide. Parent comment

Re:How to solve most NLP problems: a step-by-step guide by nl on Thursday January 25, 2018 @03:01AM (#16229478)
The Gensim version of FastText doesn’t support subword embeddings without additional support.

FastText itself (the command line program and the pretrained embeddings together) is a decent starting point for classification though.

[ Parent | on HN ]
Re:How to solve most NLP problems: a step-by-step guide by thomasahle on Thursday January 25, 2018 @04:10AM (#16229717)
The latest gensim does support fasttext .bin files and subwords (certainly using it with out of vocabulary words right now.) It doesn't support fasttext classification though.
[ Parent | on HN ]
Re:How to solve most NLP problems: a step-by-step guide by nl on Thursday January 25, 2018 @05:51AM (#16230063)
Oh that's awesome! I've been pre-processing and generating separate embedding files.
[ Parent | on HN ]