Ask HN: Libraries for classification of text

Re:Ask HN: Libraries for classification of text by jgrahamc on Friday May 11, 2012 @08:05AM (#3958790)

You are just looking for a multi-label text classifier by the sounds of things. You could start with Weka: http://www.cs.waikato.ac.nz/ml/weka/ (see http://weka.wikispaces.com/Text+categorization+with+Weka) or there's the CMU toolkit called Rainbow (http://www.cs.cmu.edu/~mccallum/bow/rainbow/).

Or if you want something simple I wrote about how to create a naive Bayesian text classifier in Dr. Dobbs some time ago: http://www.drdobbs.com/tools/184406064

[ Parent | on HN ]

Re:Ask HN: Libraries for classification of text by ColinWright on Friday May 11, 2012 @08:09AM (#3958805)

Thanks. And yes, I think I am, which is why I'm sure such things must not only exist, but should probably be readily available and reasonably easy to use.

I have written a Bayesian classifier before, but that was binary, not multi-label. I can run multiple binary Bayesian classifiers, but that's probably not the best thing to be doing.

Hence the question.

I'll check your suggestions - thanks.

Added in edit: The package "bow" doesn't compile on my machine, so now I'm looking at an undetermined amount of time fixing the package so it does compile. Always fun.

[ Parent | on HN ]

Re:Ask HN: Libraries for classification of text by ColinWright on Friday May 11, 2012 @09:29AM (#3959067)

So many errors thrown by bow that there's no hope of recovery. And this is the problem, every package I try either doesn't compile, doesn't run, doesn't do what I need, or produces the wrong answers.

Looks like I'll have to re-invent the wheel.

[ Parent | on HN ]