Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on We should start to add “ai.txt” as we do for “robots.txt”. Parent comment
At least in my country (Germany), respecting robots.txt is a legal requirement for data mining. See German Copyright Code, section 44b: https://www.gesetze-im-internet.de/urhg/__44b.html
(IANAL)
There are no comments on this comment yet.
At least in my country (Germany), respecting robots.txt is a legal requirement for data mining. See German Copyright Code, section 44b: https://www.gesetze-im-internet.de/urhg/__44b.html
(IANAL)