News for hackers. Stuff that matters.

A comment on Ad Blockers Are Also Changing the Game for SaaS and Web Developers. Parent comment

Re:Ad Blockers Are Also Changing the Game for SaaS and Web D... by TillE on Thursday October 29, 2015 @03:21PM (#10473577)
Every well-behaved bot (ie, almost all of them) has its own user agent string. You can just grep -v those out.
[ Parent | on HN ]
Re:Ad Blockers Are Also Changing the Game for SaaS and Web D... by mjn on Thursday October 29, 2015 @05:29PM (#10474458)
I wish that were true, but I'd estimate that less than half of the bot hits on my website properly identify themselves as bots. Most of the crawlers running on DigitalOcean/AWS/etc. seem to use a user-agent string lifted from one of the common browsers.
[ Parent | on HN ]
Re:Ad Blockers Are Also Changing the Game for SaaS and Web D... by kuschku on Thursday October 29, 2015 @07:38PM (#10475261)
Check for the order of the headers and the TLS protocols it claims to support – those are useful for identification.
[ Parent | on HN ]