DuckDuckGo vs Google

Re:DuckDuckGo vs Google by thinkloop on Wednesday September 20, 2017 @01:57PM (#15296525)

Time records don't have to be scraped from the site or retrieved from APIs (what APIs btw? Isn't it all scraping?). When the search engine crawls a new page, or notices an update to a previously crawled page, as long as you're crawling thoroughly, those dates can be pretty accurate.

[ Parent | on HN ]

Re:DuckDuckGo vs Google by sitharus on Wednesday September 20, 2017 @04:51PM (#15298127)

DuckDuckGo doesn't just run a web crawler, it aggregates from many sources including Bing and area specific APIs. Not all of these sources supply date information so you'd end up with some results having it and others not.

Information is here: https://duck.co/help/results/sources

[ Parent | on HN ]

Re:DuckDuckGo vs Google by thinkloop on Wednesday September 20, 2017 @05:27PM (#15298442)

Any idea why search engines would allow API access for a competing search engine? Usually APIs come with a caveat that you can't use them to rebuild the same service. Also for ddg's level of traffic, it seems like special deals would need to made, not just a general access key.

[ Parent | on HN ]

Re:DuckDuckGo vs Google by dredmorbius on Thursday September 21, 2017 @07:20AM (#15302293)

Weakening Google's monopoly.

[ Parent | on HN ]

Re:DuckDuckGo vs Google by JasonSage on Wednesday September 20, 2017 @04:48PM (#15298100)

DuckDuckGo does not do all scraping itself, I think. This is why there's the issue of "other sources" not providing dates.

[ Parent | on HN ]