Re:Harvesting data from websites using WebKit and PyQt4
by mahmud on Tuesday November 10, 2009 @10:36AM
(#933188)
What is a "bot-like" user agent? Is there a list somewhere of user-agents excluded from advertising clickstreams?
The networks can detect fraudulent clicks easily, it's the site owners who will have their accounts frozen.
Re:Harvesting data from websites using WebKit and PyQt4
by riklaunim on Tuesday November 10, 2009 @11:24AM
(#933307)
They may get frozen accounts, but the ad publishers don't froze them just like that (everyone could paralyze ad publishing on sites they don't like) so if they see that "click" was made with "I'm a bot that click things" user agent they will detect "invalid" click, not sneaky fraud attempts :) (although someone may also use PyQt4 webkit apps as a fraud apps, but it's not the point of this code tutorials). It may be used in "bad" or "good" ways.
This tutorial shows whats possible with WebKit, which isn't possible with CURL :)