News for hackers. Stuff that matters.
Re:Show HN: Copy React code from any site by spinny on Saturday July 09, 2022 @06:00PM (#32039682)
Google respects robots.txt. Allowing Google scraping is optional. In fact many websites serve more content to google bot than to you before you log in, google bots clip through paywalls

There are no comments on this comment yet.