News for hackers. Stuff that matters.
Re:Aussie wunderkind gets $US250k for technology that could ... by naner on Sunday January 15, 2012 @11:18PM (#3469348)
Pretty interesting. Fully automated text summarization certainly isn't new (libots, Classifier4j, OSX's summarization service, Copernic Summarizer, etc.) but I haven't yet seen any implementations that use a machine learning approach.

EDIT: A better integrated summarizer obviously won't "revolutionize the web", though.

Re:Aussie wunderkind gets $US250k for technology that could ... by nl on Monday January 16, 2012 @01:50AM (#3469672)
Measurement in summarization is very inexact, and there are no standards for measuring it.

I've experimented with machine learning and haven't had great results especially if you want a small summary.

I wrote Classifier4J, and the summarizer in that does pretty well - well enough that it has been ported to C# and as a patch for Python NLTK.

Re:Aussie wunderkind gets $US250k for technology that could ... by marshray on Monday January 16, 2012 @12:51AM (#3469546)
Somehow "May summarize the web up to 30% better!" just doesn't have the same ring to it.
Re:Aussie wunderkind gets $US250k for technology that could ... by indubitably on Monday January 16, 2012 @01:27AM (#3469624)
I don't really see how 30% better is going to make a qualitative difference in the utility of text on the web.
Re:Aussie wunderkind gets $US250k for technology that could ... by marshray on Monday January 16, 2012 @01:44AM (#3469653)
I can't even think of any time other than raw search results that I read auto-generated summaries now anyway.

Of course, maybe if the summaries were just a little better..it'd revolutionize the whole web! :-)

Re:Aussie wunderkind gets $US250k for technology that could ... by ak2012 on Monday January 16, 2012 @01:50AM (#3469673)
does this all work based on picking up key sentences or can it rewrite content as well?
Re:Aussie wunderkind gets $US250k for technology that could ... by robryan on Monday January 16, 2012 @08:27AM (#3470525)
Doesn't seem like like it rewrites content, also seems to often use a sentence as the first one that refers to a previously introduced concept in the article that has no context in the summary.

This doesn't really surprise me as in the time he has been working in ai/ml/nlp I don't think there would have been much time to do more than learn up to and implement some of the current state of the art. The named entity recognition for the keywords seems okay.

I did a bit of reading on summarization during my thesis, enough to know it is a big and difficult problem. I hope he keeps at it, seems like a good start but a long way to go.

Re:Aussie wunderkind gets $US250k for technology that could ... by spicyxtreme on Monday January 16, 2012 @05:47AM (#3470199)
I think 30% more is pretty significant. Especially if applied to email, long articles etc.

However, still not sure if it ensures that i wouldn't miss out on anything important which may be fatal if it was an important email.

PLUS it doesnt say if it picks up on emotional context which is super important in interpersonal communications?