News for hackers. Stuff that matters.

A comment on Extend robots.txt to specify session variable names?. Parent comment

Re:Extend robots.txt to specify session variable names? by foxylad on Wednesday January 11, 2017 @06:41PM (#13378538)
Maintaining a list of bot useragents would be a pain, but I guess testing if the useragent contains 'bot' would work for most.
[ Parent | on HN ]

There are no comments on this comment yet.