News for hackers. Stuff that matters.
Re:DuckDuckGo is blowing up by _delirium on Thursday March 29, 2012 @02:26PM (#3772385)
I think that might boil down to Bing apparently not having indexed you. From what I can tell, DDG gets a decent proportion of its search results from the Yahoo BOSS API, which I believe is these days mostly feeding Bing data.

The results there look pretty similar, anyway: http://www.bing.com/search?q=curvio

Re:DuckDuckGo is blowing up by AznHisoka on Thursday March 29, 2012 @04:36PM (#3772994)
This is the problem... In the short run, DDG may be winning small victories. In the long run, they definitely need to build their own index. They need to at least start now, then turn the switch on when it's ready. Of course it's gonna require major infrastructure, but they are building a search engine, so that's a given.
Re:DuckDuckGo is blowing up by minwcnt5 on Thursday March 29, 2012 @05:31PM (#3773212)
Building their own index is only worthwhile if they can build a good ranking algorithm to go along with it. And they're at a huge disdvantage in doing so because they don't track users to improve quality whereas Bing does.
Re:DuckDuckGo is blowing up by alecco on Friday March 30, 2012 @11:43AM (#3776500)
it could be an open source project, i'd be interested
Re:DuckDuckGo is blowing up by TomAnthony on Saturday March 31, 2012 @08:45AM (#3780184)
You could start by playing around with this data: http://commoncrawl.org/

The ways you can interact with it currently are limited, but I think that'll improve.

Re:DuckDuckGo is blowing up by alecco on Saturday March 31, 2012 @01:38PM (#3780944)
That project looks amazing. But it'd be nicer to have some sort of compressed raw dump to use different tools.