News for hackers. Stuff that matters.
Re:Ask PG: Polite ways to scrape HN? by sh1mmer on Thursday September 23, 2010 @05:18PM (#1721502)
I also made a YQL table for HackerNews a while back which should be as polite to the site as possible.

http://developer.yahoo.com/yql/console/?q=select%20*%20from%...

YQL implements a bunch of caching layers so it should tread as lightly as possible.

Disclaimer: I do work for Yahoo!

Re:Ask PG: Polite ways to scrape HN? by util on Thursday September 23, 2010 @06:59PM (#1721895)
Just curious, especially after the deal with Microsoft: Has Yahoo made any long term commitments to support this? Would love to use this for some projects.
Re:Ask PG: Polite ways to scrape HN? by sh1mmer on Sunday September 26, 2010 @08:54AM (#1729065)
Yes. It's been explicitly stated on our blog and on the YQL page that it's not going away.

Specifically we've promised a minimum of 6mo notice if we ever did decide to shut it down.