News for hackers. Stuff that matters.

A comment on Tell HN: We Need Robots.txt but for AI. Parent comment

Re:Tell HN: We Need Robots.txt but for AI by thatoneguytoo on Tuesday January 10, 2023 @09:46AM (#34325590)
Even if it's not legally binding, it will be, and should be embarrassing for a big corp to do things that they are specifically not asked to do.

For example, Google doesn't really surface those pages hidden by robots.txt, even if they can.

[ Parent | on HN ]

There are no comments on this comment yet.