Re:Ask HN: What do people use to prevent crawlers?
by jeremyliew on Sunday July 23, 2017 @11:30AM
(#14832686)
I don't understand why you'd want to stop crawlers. If you didn't want people to see your content, it probably shouldn't be on the public web.
[ Parent
| on HN ]
There are no comments on this comment yet.