News for hackers. Stuff that matters.
Re:HackerFollow: Follow HN Users by mahmud on Wednesday October 06, 2010 @11:26AM (#1764308)
Instead of crawling by #id, crawl by new posts from the /newest page. For each post, split it into multiple pages, setting the parent id/title that way. Not that you have to, but a future suggestion.
Re:HackerFollow: Follow HN Users by jeromec on Wednesday October 06, 2010 @11:42AM (#1764394)
I'm guessing the info is currently scraped from the 'threads?id=username' page, but the title to each story is already there after the word 'on'.