News for hackers. Stuff that matters.

A comment on Robots.txt as a Security Measure?. Parent comment

Re:Robots.txt as a Security Measure? by zaarn on Wednesday July 10, 2019 @09:02AM (#20401536)
Those crawlers can almost always be recognized by the UA.
[ Parent | on HN ]
Re:Robots.txt as a Security Measure? by hjalle on Wednesday July 10, 2019 @09:08AM (#20401573)
Yes, no doubt.
[ Parent | on HN ]