News for hackers. Stuff that matters.

A comment on How to crawl a quarter billion webpages in 40 hours (2012). Parent comment

Re:How to crawl a quarter billion webpages in 40 hours (2012) by tylerhou on Thursday July 05, 2018 @04:38AM (#17461736)
Web crawling is necessary, but not sufficient. You won't be able to build a better Google just because you can crawl the web, but you won't be able to build a better Google if you can't crawl the web.
[ Parent | on HN ]

There are no comments on this comment yet.