News for hackers. Stuff that matters.
Re:Robots.txt by robbiemitchell on Monday February 11, 2013 @02:09PM (#5202618)
Making your site easy to crawl and find can be spammy when taken too extremes, yes, but it's also about quality basics. Good titles, site structure, URL structure, relevant internal linking, etc.

As an analogy, making your restaurant easy to find (relevant name, standard names for things, signs out front, etc.) is important unless you're so well-branded that can get by on having a secret, unmarked door.

There are no comments on this comment yet.