News for hackers. Stuff that matters.
Re:Removing my site from Google search by bhartzer on Sunday October 03, 2021 @09:45PM (#28742163)
Google will still index the url even if you block them from crawling the page via robots.txt. They will index the lane, and it can still rank well. Google just puts up a message in the results saying they’re not allowed to crawl the page.

There are no comments on this comment yet.