News for hackers. Stuff that matters.

A comment on Facebook releases 300-dimensional pretrained Fasttext vectors for 90 languages.

Re:Facebook releases 300-dimensional pretrained Fasttext vec... by sorenvrist on Thursday March 02, 2017 @01:29PM (#13776750)
I tried using the danish .bin with fastText predict and a single danish sentence but I keep on getting an assert error from vector.cpp around A._m not equal to _m. Am I doing something wrong?

./fastText predict wiki.da.bin fileWithASingleLine 1

[ Parent | on HN ]
Re:Facebook releases 300-dimensional pretrained Fasttext vec... by exgrv on Thursday March 02, 2017 @02:14PM (#13777224)
These models were trained in an unsupervised way, and thus cannot be used with the "predict" mode of fastText.

The .bin models can be used to generate word vectors for out-of-vocabulary words:

  > echo 'list of words' | ./fasttext print-vectors model.bin
or

  > ./fasttext print-vectors model.bin < queries.txt
where queries.txt is a list of words you want a vector representation for.
[ Parent | on HN ]