News for hackers. Stuff that matters.
Re:I have 6.000.000 RSS articles in a DB. What can I do? by bulte-rs on Thursday June 21, 2012 @06:25AM (#4141262)
You've got the basis for a "you-like-this-so-perhaps-you-will-want-to-read-this" recommendation engine. Perform some - mentioned in another reply - n-gram analysis on the corpus; do some basic cosine-similarity analysis with the feeds people subscribe to and see what pops up. Try other techniques (from e.g. ICWSM[1]) (last time I did something like this is April 2007); iterate; analyse results; publish.

At least you'll have fun (YMMV)...

[1] http://www.icwsm.org/[2007-2011]

Re:I have 6.000.000 RSS articles in a DB. What can I do? by robertpohl on Thursday June 21, 2012 @06:45AM (#4141303)
I already use "find similar articles" techniques using Lucene. But I'm thinking it might be more interesting in another more data-centered website?
Re:I have 6.000.000 RSS articles in a DB. What can I do? by dodo53 on Thursday June 21, 2012 @06:56AM (#4141333)
Does your reader record which items in a feed were read? I'm sure lots of feed providers would be interested in metrics on which of their articles were frequently read (and possibly some clustering of interests based on what else readers subscribe to)
Re:I have 6.000.000 RSS articles in a DB. What can I do? by robertpohl on Thursday June 21, 2012 @07:04AM (#4141350)
Yes it does! The problem is the low activity on the site. If the traffic grew the meta data would explode ;)