Re:Google Bot Attempts to Crawl Shortest URLs First
by meow on Saturday June 25, 2011 @10:48AM
(#2695744)
That's probably because short urls usually tend to be static pages while long ones tend to be dynamically generated content.
[ Parent
| on HN ]
Re:Google Bot Attempts to Crawl Shortest URLs First
by personalcompute on Saturday June 25, 2011 @10:50AM
(#2695750)
His entire site that he observed this behavior on is static.