News for hackers. Stuff that matters.

A comment on Apple switches from Bing to Google for Siri web search on iOS and Mac Spotlight. Parent comment

Re:Apple switches from Bing to Google for Siri web search on... by thomasahle on Tuesday September 26, 2017 @08:22AM (#15337958)
> maybe their robots file only allows google?

It's pretty easy to check: https://forums.developer.ebay.com/robots.txt

    Sitemap: /sitemap.xml
    
    User-Agent: sitebot
    Disallow: /
 
    User-Agent: *
    Disallow: /accounts/
    Disallow: /users/
    Disallow: /revisions/
    Disallow: /search
    Disallow: /*sort=newest
    Disallow: /*sort=hottest
    Disallow: /*sort=votes
    Disallow: /commands/
    Disallow: /badges/
    Disallow: /comments
    Disallow: /storage/
Doesn't seem like anything disallows https://forums.developer.ebay.com/questions/20235/listing-it...
[ Parent | on HN ]

There are no comments on this comment yet.