Re:Hnweekly: weekly top stories from Hacker News
by xtimesninety on Friday December 26, 2008 @07:43AM
(#410133)
nice work too :)
[ Parent
| on HN ]
Re:Hnweekly: weekly top stories from Hacker News
by siong1987 on Friday December 26, 2008 @10:10PM
(#410695)
How long do your crawl the Ycombinator once? Do you actually crawl every page on YC?
Re:Hnweekly: weekly top stories from Hacker News
by xtimesninety on Friday December 26, 2008 @10:37PM
(#410710)
I scrape only the front page once every ~4hrs (minimum)
Nearlyfreespeech.net doesn't have cron yet, so I'm using onlinecronjobs.com. If you want to scrape it on demand just go to http://hnweekly.watdahel.com/index/scrape
Re:Hnweekly: weekly top stories from Hacker News
by siong1987 on Saturday December 27, 2008 @04:42AM
(#410941)
But, if you only scrape the frontpage, how can you know the points for all the past stories which are not on the frontpage anymore?
Re:Hnweekly: weekly top stories from Hacker News
by xtimesninety on Saturday December 27, 2008 @07:15AM
(#410991)
It's not 100% accurate, but it's close. The reason I did the website is so I can catch up with the good stories that were submitted earlier during the week (I usually read during weekends).