News for hackers. Stuff that matters.
Re:Robots.txt for the NYT has a specific exclusion for an 19... by arbitrage on Monday March 29, 2021 @09:23AM (#26621132)
it's more nuanced than that.

they prefer to be able to remove information about themselves.

they strongly prefer you don't have the ability to remove information about someone else.

There are no comments on this comment yet.