News for hackers. Stuff that matters.

A comment on Extend robots.txt to specify session variable names?.

Re:Extend robots.txt to specify session variable names? by pastyboy on Wednesday January 11, 2017 @06:20PM (#13378410)
Test for bots (useragent) before adding the variable, requires array of most common bots - if bot don't create a session ...
[ Parent | on HN ]
Re:Extend robots.txt to specify session variable names? by foxylad on Wednesday January 11, 2017 @06:41PM (#13378538)
Maintaining a list of bot useragents would be a pain, but I guess testing if the useragent contains 'bot' would work for most.
[ Parent | on HN ]