News for hackers. Stuff that matters.
Re:Become Ungoogleable by tenplusfive on Thursday July 20, 2023 @02:40PM (#36804790)
This is actually the correct way. Robots.txt only stops google from crawling your website, but it might still appear in the index. If you search for the site, then it is shown in the search results, but without any of the content of the page. If you want to prevent indexing as well, you'll have to do this.

Also explained here: https://developers.google.com/search/docs/crawling-indexing/...

There are no comments on this comment yet.