News for hackers. Stuff that matters.
Re:Show HN: TL;DRizer - an algorithmic summarizer webapp/api... by sherjilozair on Wednesday April 10, 2013 @03:02AM (#5523636)
This misses the most important line in the article: Acquiring Summly seems to have been an almost incidental side effect of a deal Yahoo made with SRI for a piece of "summarization technology".
Re:Show HN: TL;DRizer - an algorithmic summarizer webapp/api... by mohaps on Wednesday April 10, 2013 @03:05AM (#5523644)
the algo is still kinda "dumb". It basically tries to get top N keywords - most frequent non stopwords, stems them and goes through the sentences looking for which of them (upto max summary length) contain the keywords. I'll keep whittling at it over nights/weekends to see if I can make it more "semantically aware"

edit: some work is needed on the tokenization also. currently, I don't preserve non-period punctuation.

Re:Show HN: TL;DRizer - an algorithmic summarizer webapp/api... by romain_g on Wednesday April 10, 2013 @06:30AM (#5524263)
You might want to look into topic modeling to extract the most meaningful topics (set of co-occuring words). It could greatly improve your results compared to the keyword approach. Interesting initiative, keep us posted !
Re:Show HN: TL;DRizer - an algorithmic summarizer webapp/api... by mmahemoff on Wednesday April 10, 2013 @03:19AM (#5523688)
There's tons of human-generated TLDRs out there; I wonder if anyone's tried machine-learning from them.