News for hackers. Stuff that matters.
Re:Ask HN: How to stop Google indexing dynamic search pages? by wejick on Thursday July 19, 2018 @01:53AM (#17564183)
I think adding rule for /search* to your robot is easier way to block google bot
Re:Ask HN: How to stop Google indexing dynamic search pages? by dougunplugged on Thursday July 19, 2018 @02:20AM (#17564256)
Don't do this until Google sees your new robots meta directives (or canonical tag) on these pages, that way they will drop from the index. Then you can add this to your robots.txt to prevent it being crawled again.