Re:Google Bot Attempts to Crawl Shortest URLs First
by xyzzyz on Sunday June 26, 2011 @06:12AM
(#2697766)
The thing is, the deeper you are, the longer are the urls, so if you do a breadth first search, you are more likely to visit short urls first.
[ Parent
| on HN ]
There are no comments on this comment yet.