Re:The Brotherhood of the Ad Blockers
by TeMPOraL on Thursday May 10, 2018 @05:27PM
(#17043115)
robots.txt is a gentlemen's agreement between a site and search engine running automated crawlers. It has no meaning for regular visitors.
[ Parent
| on HN ]
There are no comments on this comment yet.