News for hackers. Stuff that matters.
Re:Google Launches BigQuery and (AI/ML) Prediction API by hooande on Wednesday May 19, 2010 @04:38PM (#1362270)
If I understand the Prediction API correctly it's a text classifier. I would imagine it's a bayesian classifier, like the kind found in most spam filters. I don't know how accurate it is...it would be nice to see how it performs on a standard corpus (like the 20newsgroups).

If you're handy with linux and you don't want to deal with their API, you could probably just download and install rainbow http://www.cs.umass.edu/~mccallum/bow/rainbow/ (though it is a very difficult installation).

Re:Google Launches BigQuery and (AI/ML) Prediction API by sketerpot on Wednesday May 19, 2010 @04:49PM (#1362299)
It can be used as a text classifier. It takes as input a collection of (output, input1, input2, ..., input_n) tuples, stored in the newly-announced Google Storage, and then uses a variety of machine learning algorithms (which I would bet includes some Bayesian stuff) to build a model which it can use to take (input1, input2, ..., input_n) tuples and predict the corresponding output.

So, that's the API. You can do a lot of the same things offline, with almost the same file format, using Weka:

http://en.wikipedia.org/wiki/Weka_(machine_learning)

So if you're interested in playing around with Google's Prediction API, you should probably download Weka and fiddle with it some. It's pretty easy to get started with, and it will definitely give you an idea for the sort of thing you can do here.

Re:Google Launches BigQuery and (AI/ML) Prediction API by smokinn on Wednesday May 19, 2010 @09:27PM (#1362971)
Another interesting project is crm114: http://crm114.sourceforge.net/

It's ridiculously easy to use. I used it for identification of spam/scam messages and setting it up was just 5 lines of code.

I wrote a blog post about using it here: http://smokinn.com/blog/post/253

Re:Google Launches BigQuery and (AI/ML) Prediction API by dlib on Wednesday May 19, 2010 @05:27PM (#1362409)
I built a bayesian text classifier on App Engine a few weeks ago but it was too slow to be of any use (the datastore that is). Still fun to get it to work though. Did stumple upon a Bayesian classifier web service: http://www.uclassify.com/Default.aspx

Will certainly check out Weka, it's installed on the pc's at my college so when I get the chance I will.