Re:Show HN: Business.txt - Standard Proposal
by novaleaf on Monday August 27, 2012 @10:16AM
(#4438887)
what about meta entry(s) in the robots.txt, specifying if additional things like business.txt exist (and where)
[ Parent
| on HN ]
But robots.txt is just for exclusion directives, right? AFAICT it's not really used for assistance with finding resources.