Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on How to crawl a quarter billion webpages in 40 hours. Parent comment
This classifier can be trained using logistic regression.
This is slightly tricky, but effective. I've been meaning to write in more depth about this topic (smart crawling).
[edit: I'm stepping out so I can't write more right now. You can email me if you have any questions about this.]
There are no comments on this comment yet.
This classifier can be trained using logistic regression.
This is slightly tricky, but effective. I've been meaning to write in more depth about this topic (smart crawling).
[edit: I'm stepping out so I can't write more right now. You can email me if you have any questions about this.]