Re:Blekko Bans 1.1 Million Spammy Domains Via New Algorithm
by duskwuff on Thursday March 10, 2011 @11:35AM
(#2309682)
It still ends up including a lot of legitimate sites I recognize for crazy reasons. The main DNSSEC site, dnssec.net, and he security blog dshield.org are both apparently "mfa" ("made for adsense"), the musician deadmau5.com is "spam", and boonex.com, the author of the Dolphin CMS, is a "malware-domain".
With that kind of hit rate, I have to wonder how many of the 1.1M domains they banned were errors. :/
Although that includes some "normal" sites too that simply prevent crawling.