News for hackers. Stuff that matters.
Re:Help: FBI criminally charged me with $6MM loss for hotlin... by rezbull on Monday March 07, 2022 @11:52PM (#30596566)
“…treat the absence of one as a lack of consent. ” - do you have a source for this?

Their documentation states otherwise https://developers.google.com/search/docs/advanced/robots/ro...

Re:Help: FBI criminally charged me with $6MM loss for hotlin... by otterley on Tuesday March 08, 2022 @08:50AM (#30599817)
You are correct; my mistake. Nevertheless S3 returns a 403 (unauthorized) response for robots.txt by default which causes Google not to index it.