Re:Ask HN: Is there room for another search engine?
by mrweasel on Sunday March 26, 2017 @03:10PM
(#13962510)
DuckDuckGo do have their own crawler: https://duckduckgo.com/duckduckbot, but they are dependent on the indexes of others.
Re:Ask HN: Is there room for another search engine?
by bogomipz on Sunday March 26, 2017 @06:27PM
(#13963705)
Interesting, I had no idea. I wonder if they have or ever had plans to index themselves? The wiki link mentions they have do their own crawler.
Re:Ask HN: Is there room for another search engine?
by Vinnl on Sunday March 26, 2017 @04:00PM
(#13962868)
Yeah but neither do some of the other mentioned search engines. Apparently DDG just is even smaller than I thought.
Re:Ask HN: Is there room for another search engine?
by smarx007 on Sunday March 26, 2017 @04:18PM
(#13963000)
Ahrefs crawls actually more than any search engine other than Google: https://www.incapsula.com/blog/most-active-good-bots.html
And Bing, Yandex, and Yahoo have active crawlers.
https://en.wikipedia.org/wiki/DuckDuckGo