News for hackers. Stuff that matters.

A comment on Crawling Billions of Pages: Building Large Scale Crawling Cluster, part 1. Parent comment

Re:Crawling Billions of Pages: Building Large Scale Crawling... by Axsuul on Friday June 12, 2015 @05:24AM (#9704805)
It currently feels like 60 percent of global internet traffic is actually crawling their blog right now. Still waiting for it to load.
[ Parent | on HN ]

There are no comments on this comment yet.