News for hackers. Stuff that matters.
Re:9th Circuit holds that scraping a public website does not... by jjohansson on Wednesday September 11, 2019 @12:23PM (#20941878)
Looks like I’m wrong. They will rank pages blocked by robots.txt, but won’t index them.

https://www.google.ca/amp/s/www.searchenginejournal.com/goog...

There are no comments on this comment yet.