News for hackers. Stuff that matters.

A comment on Robots.txt for the NYT has a specific exclusion for an 1996 news article. Parent comment

Re:Robots.txt for the NYT has a specific exclusion for an 19... by curt15 on Monday March 29, 2021 @08:05AM (#26620366)
I thought the "right to be forgotten" is simply meant to prevent certain websites from appearing in search engine results. Isn't that precisely what robots.txt accomplishes? Does the right to be forgotten also compel website owners to censor their own content?
[ Parent | on HN ]
Re:Robots.txt for the NYT has a specific exclusion for an 19... by OJFord on Monday March 29, 2021 @08:24AM (#26620513)
Accomplishes the same, but it's a different mechanism.

RTBF does not use robots.txt (and then require that it be respected) on the site hosting the thing to be forgotten, it's an exclusion on the search engine side.

[ Parent | on HN ]