Re:Apple switches from Bing to Google for Siri web search on...
by thomasahle on Tuesday September 26, 2017 @08:22AM
(#15337958)
> maybe their robots file only allows google?
It's pretty easy to check: https://forums.developer.ebay.com/robots.txt
Sitemap: /sitemap.xml
User-Agent: sitebot
Disallow: /
User-Agent: *
Disallow: /accounts/
Disallow: /users/
Disallow: /revisions/
Disallow: /search
Disallow: /*sort=newest
Disallow: /*sort=hottest
Disallow: /*sort=votes
Disallow: /commands/
Disallow: /badges/
Disallow: /comments
Disallow: /storage/
The results were all on eBay's developer forums, maybe their robots file only allows google?
One advantage to DuckDuckGo is that when searching it was fairly easy to flip and try google with !g and bing with !b after getting no results on DDG.*
It would be nice if bing/google got that feature since it's really handy, and it would be exceedingly nice if they all got the ability to add custom user defined !bang commands.
*However, annoyingly, there was a bug on ddg on iPhone that would clear the search input box when it was clicked to add !g then another error when clicking in the location bar to add the !g that the '"invalid store category name" !g' query was no longer editable instead it was the URL of the encrypted Google search making it difficult to remove the !g and add the !b.