Re:Google has added DuckDuckGo as a search engine option for...
by Kiro on Wednesday March 13, 2019 @01:17PM
(#19380962)
No? Your quote basically confirms it. All organic search results are from Oath and Bing. The other 400 sources are just for fluff like widgets.
Re:Google has added DuckDuckGo as a search engine option for...
by bad_user on Wednesday March 13, 2019 @02:03PM
(#19381549)
It's worse.
AFAIK Oath / Yahoo has switched to using Bing under the hood since 2009: https://www.nytimes.com/2009/07/30/technology/companies/30so...
Re:Google has added DuckDuckGo as a search engine option for...
by amyjess on Wednesday March 13, 2019 @02:24PM
(#19381794)
Huh, the last time I tried DDG back in 2014 or so, all the search results came from Yandex, which really put me off of it.
Re:Google has added DuckDuckGo as a search engine option for...
by FabHK on Wednesday March 13, 2019 @06:16PM
(#19384476)
Having said that, Bing is no replacement for DDG.
Re:Google has added DuckDuckGo as a search engine option for...
by _bxg1 on Wednesday March 13, 2019 @04:59PM
(#19383709)
How does that work with their privacy stance? Do Yahoo/Bing get to keep and use that search data and it's just anonymized, or does DDG pay to keep it untracked?
Kind of disheartening regardless. I assumed they had their own scrappy, independent tech stack.
Re:Google has added DuckDuckGo as a search engine option for...
by londons_explore on Thursday March 14, 2019 @04:44AM
(#19387471)
Creating your own search engine in today's world is pretty much impossible.
For one thing, loads of sites load all their content via Ajax, so at a minimum you're gonna need a browser engine as the base of your crawler...
Re:Google has added DuckDuckGo as a search engine option for...
by _bxg1 on Thursday March 14, 2019 @10:54AM
(#19389747)
Headless Chrome is available and widely-used, and commonly you can get around the JS thing by simply waiting a few seconds before scraping. I'd assume the crawling itself isn't the hard part (aside from maybe just the raw compute time it takes).
> DuckDuckGo gets its results from over four hundred sources. These include hundreds of vertical sources delivering niche Instant Answers, DuckDuckBot (our crawler) and crowd-sourced sites (like Wikipedia, stored in our answer indexes). We also of course have more traditional links in the search results, which we also source from a variety of partners, including Oath (formerly Yahoo) and Bing.
https://duck.co/help/results/sources