FastText – Library for fast text representation and classification

Re:FastText – Library for fast text representation and class... by haddr on Thursday August 04, 2016 @05:13PM (#12228523)

For supervised classification this tool is suitable when your dataset is large enough. I performed some tests with binary classification (twitter sentiment) on the corpus with ~7.000 samples and the result is not impressive (~0.77). Vowpal wabbit performes slightly better here, with almost the same training time.

I'm looking forward to try it on some bigger datasets.

I also wonder if is it possible to use separately trained word vector model for the supervised task?

[ Parent | on HN ]

Re:FastText – Library for fast text representation and class... by exgrv on Thursday August 04, 2016 @07:17PM (#12229120)

Thanks for pointing this out. We design this library on large datasets and some static variables may not be well tuned for smaller ones. For example the learning rate is only updated every 10k words. We are fixing that now, could you please send us on which dataset you were testing? We would like to see if we have solved this.

[ Parent | on HN ]

Re:FastText – Library for fast text representation and class... by haddr on Thursday August 04, 2016 @07:23PM (#12229139)

sure, how can i send it to you?

[ Parent | on HN ]

Re:FastText – Library for fast text representation and class... by exgrv on Thursday August 04, 2016 @07:39PM (#12229200)

If the dataset is public, could you post a link? Otherwise, could you please send me an email? (My address can be found on the github README). Thanks!

[ Parent | on HN ]

Re:FastText – Library for fast text representation and class... by haddr on Friday August 05, 2016 @10:34AM (#12232598)

I've sent you an email

[ Parent | on HN ]

Re:FastText – Library for fast text representation and class... by nl on Thursday August 04, 2016 @05:59PM (#12228771)

What is SOA on Twitter sentiment these days? I thought it was around 80%

[ Parent | on HN ]