Re:GitHub: About This Week's Availability
by jarcoal on Friday February 10, 2012 @11:33PM
(#3578583)
Another, similar, technique is checking for a NOBOT cookie and if it doesn't exist, serve up a page that uses javascript to set the cookie, then reloads.
This requires the bot to interpret javascript, and it can easily be configured in nginx and other load balancers.
This requires the bot to interpret javascript, and it can easily be configured in nginx and other load balancers.