Ask HN: I need a brainstorm on how to collect several thousand quality RSS feeds
Google and Bing aren't doing right by me. All I'm finding are crappy SEO optimized sites. As you might surmise, there's a lot of web scraping and natural language processing in my near future, but I need a corpus of decent RSS feeds to start scraping.
What I'm looking for is a way to collect several thousand decent economic and financial news RSS feeds for my startup, Newsley.com.
Aside from gathering these by hand, has anyone found a great directory of RSS feeds? (If you have a list of a whole lot of economic and financial feeds in your Google Reader account, export the list, email it to me. I'll buy you beer or your beverage of choice. )
Alternatively, I'd love to hear a brainstorm or suggestions on where to find collections of RSS feeds. or ways in which a bunch of RSS feeds could be gathered.
Suggestions?
(
19 comments
| 17 points
| on HN
)
wget -r google news and see what their sources are ?
http://www.feedage.com/categories/News/1/4
karma++ for wget google news. I looked at feedage, but signal:noise ratio kinda sucks.
Being IP banned from google is not funny.
http://www.postrank.com/developers/api#topic
http://www.bloglines.com/search?q=finance&t=f&ql=en&...
plus a top 1000 feeds:
http://beta.bloglines.com/topfeeds
http://marshallk.com/its-my-birthday-you-should-make-me-a-pr...
It could work for you too...
http://regator.com/#feedsearch:section:20:0