News for hackers. Stuff that matters.

A comment on Google says there are now 10^12 unique URLs. I am proud to announce the 2nd trillion.. Parent comment

Re:Google says there are now 10^12 unique URLs. I am proud t... by brianr on Monday July 28, 2008 @07:37AM (#258981)
Looks like it hit all of the links on the first page (there are 8x5 boxes = 40) and didn't find anything interesting, so it didn't crawl any deeper. If the second-level pages had more interesting/unique content, I bet it would've kept going.
[ Parent | on HN ]

There are no comments on this comment yet.