News for hackers. Stuff that matters.
Re:Giving up on Google by ggrot on Monday September 13, 2010 @08:15PM (#1688844)
Maybe a minor quibble, but isn't DDG powered by Yahoo BOSS with features added on top? Yet, Rob then goes on to say "Yahoo can't be taken seriously" and points out queries where Yahoo does a poor job of handing synonyms - DDG has the same problem for the exact same query if you try it. Furthermore, the other queries which he suggests give irrelevant results on Google seem to give me irrelevant results on DDG.
Re:Giving up on Google by epi0Bauqu on Tuesday September 14, 2010 @06:14AM (#1690071)
DDG is actually a hybrid of my own crawling/indexing and BOSS/Bing/others. Additionally, I don't use the others straight up. So for some queries they may look similar and for others they will look completely different.

Wrt to spam sites, DDG often looks a lot different because I maintain a large database of spam sites that I remove from results. I see these crop up all the time in the API feeds I use. It's over 60M in just the main tlds (non country level domains).

Re:Giving up on Google by alecco on Monday September 13, 2010 @08:54PM (#1688942)
Among the differences, DDG blocks MFA content mills and junk sites. If you report one they add it quite fast.
Re:Giving up on Google by moultano on Monday September 13, 2010 @09:12PM (#1688988)
Yahoo certainly tries to do that too, although I guess you're getting the union of yahoo/bing's spam-fighting and DDG's spam fighting.

I suspect that of the two, yahoo's has a much bigger impact given the size of the teams involved.

Re:Giving up on Google by epi0Bauqu on Tuesday September 14, 2010 @06:14AM (#1690072)
Actually I remove tons of spam from the Yahoo, Bing & other feeds.
Re:Giving up on Google by moultano on Tuesday September 14, 2010 @10:31AM (#1690668)
What order of magnitude is tons? Not to take away from what you're doing, but historically 90% of new domains are spam.
Re:Giving up on Google by epi0Bauqu on Tuesday September 14, 2010 @12:44PM (#1691214)
I'd have to check for exact numbers, but for a large % of searches I'm removing links from those APIs.
Re:Giving up on Google by patrickaljord on Monday September 13, 2010 @09:23PM (#1689015)
> If you report one they add it quite fast.

Probably because few people report sites.