Google search indexes itself

Re:Google search indexes itself by Igglyboo on Wednesday September 10, 2014 @02:20PM (#8298082)

Seems like they could easily fix this with robots.txt or something similar, I really doubt it's oversight on their part either.

Any ideas why they're doing this?

[ Parent | on HN ]

Re:Google search indexes itself by andybalholm on Wednesday September 10, 2014 @02:32PM (#8298171)

I assume that some site has hostgator-related links with two slashes instead of one. Due to the two slashes, the GoogleBot doesn't realize that it's indexing their own results pages.

[ Parent | on HN ]

Re:Google search indexes itself by spindritf on Wednesday September 10, 2014 @02:38PM (#8298204)

They disallow /search

    User-agent: *
    Disallow: /search

but maybe //search slipped thorough?

[ Parent | on HN ]

Re:Google search indexes itself by johnmu on Wednesday September 10, 2014 @03:47PM (#8298657)

This is just a bug, sorry.

[ Parent | on HN ]

Re:Google search indexes itself by guan on Wednesday September 10, 2014 @02:38PM (#8298200)

They probably want to index some pages on google.com, but not search results. To exclude search results, someone wrote something to exclude URLs that start with /search, and forgot that //search works the same way.

[ Parent | on HN ]