Re:AI scrapers request commented scripts
by bigbuppo on Saturday November 01, 2025 @01:16PM
(#45783403)
Robots are supposed to behave. It was a solved problem 30 years ago until AI bros unsolved it. Any entity that does not obey robots.txt is by definition a malicious actor.
...and in this hypothetical, this person is serving them via an unauthenticated http server and hoping that clients will respect robots.txt?