Re:Google Says It'll Scrape Everything You Post Online for AI
by scarface_74 on Monday July 03, 2023 @07:06PM
(#36579967)
Any history of Google not respecting it?
[ Parent
| on HN ]
Re:Google Says It'll Scrape Everything You Post Online for AI
by tteggel on Tuesday July 04, 2023 @12:07PM
(#36588523)
Google does not respect robots.txt if a page is linked to from other sites
https://developers.google.com/search/docs/crawling-indexing/...