News for hackers. Stuff that matters.

A comment on Company withdrawing from Facebook as analytics show 80% of ad clicks from bots. Parent comment

Re:Company withdrawing from Facebook as analytics show 80% o... by fsniper on Tuesday July 31, 2012 @05:39AM (#4316417)
That's it. A "bad bot" would not check robots.txt, but a legitimate user would check it. So looking for the software not checking robots.txt combined with user agent matching for good bots, you would have a good matching ratio.
[ Parent | on HN ]

There are no comments on this comment yet.