News for hackers. Stuff that matters.

A comment on 1/500th of humanity's time is spent on Facebook. Parent comment

Re:1/500th of humanity's time is spent on Facebook by diego on Wednesday December 02, 2009 @10:59PM (#973664)
There are at least tens of millions of web sites. This site ranks 3500 on Alexa and 12k on Compete. Google knows that and prioritizes its crawlers accordingly.

Maintaining a fresh index of the top 100k sites is where search engines get their best bang for the buck.

[ Parent | on HN ]
Re:1/500th of humanity's time is spent on Facebook by endtime on Thursday December 03, 2009 @05:24AM (#974071)
Doesn't Google use Pagerank for crawling policy/priority?
[ Parent | on HN ]