Re:Google says there are now 10^12 unique URLs. I am proud t...
by aristus on Monday July 28, 2008 @02:57PM
(#259443)
(guessing) sites like hackernews are indexed primarily by recursion (few direct inbound links to specific stories).
Correct. Notice that it is difficult to find old HN comments on Google, since after a while there are no short paths from the home page to them. In practice & all else being equal (quality, length, spamminess, speed, age, uniqueness, PR, etc), the maximum depth a page can afford to have is about 6 or 7.
Correct. Notice that it is difficult to find old HN comments on Google, since after a while there are no short paths from the home page to them. In practice & all else being equal (quality, length, spamminess, speed, age, uniqueness, PR, etc), the maximum depth a page can afford to have is about 6 or 7.