News for hackers. Stuff that matters.
Re:We should start to add “ai.txt” as we do for “robots.txt” by majewsky on Wednesday May 10, 2023 @09:39AM (#35887206)
> All a robots.txt is is a polite request to please follow the rules in it

At least in my country (Germany), respecting robots.txt is a legal requirement for data mining. See German Copyright Code, section 44b: https://www.gesetze-im-internet.de/urhg/__44b.html

(IANAL)

There are no comments on this comment yet.