Re:Show HN: TL;DRizer - an algorithmic summarizer webapp/api...
by sherjilozair on Wednesday April 10, 2013 @03:02AM
(#5523636)
This misses the most important line in the article: Acquiring Summly seems to have been an almost incidental side effect of a deal Yahoo made with SRI for a piece of "summarization technology".
[ Parent
| on HN ]
Re:Show HN: TL;DRizer - an algorithmic summarizer webapp/api...
by mohaps on Wednesday April 10, 2013 @03:05AM
(#5523644)
the algo is still kinda "dumb". It basically tries to get top N keywords - most frequent non stopwords, stems them and goes through the sentences looking for which of them (upto max summary length) contain the keywords. I'll keep whittling at it over nights/weekends to see if I can make it more "semantically aware"
edit: some work is needed on the tokenization also. currently, I don't preserve non-period punctuation.
Re:Show HN: TL;DRizer - an algorithmic summarizer webapp/api...
by romain_g on Wednesday April 10, 2013 @06:30AM
(#5524263)
You might want to look into topic modeling to extract the most meaningful topics (set of co-occuring words). It could greatly improve your results compared to the keyword approach. Interesting initiative, keep us posted !