News for hackers. Stuff that matters.

A comment on “Magic links” can end up in Bing search results, rendering them useless. Parent comment

Re:“Magic links” can end up in Bing search results, renderin... by efreak on Thursday June 30, 2022 @09:25AM (#31932069)
Some services ignore global disallow, but will respect rules explicitly targeted at them.
[ Parent | on HN ]
Re:“Magic links” can end up in Bing search results, renderin... by boxed on Thursday June 30, 2022 @03:07PM (#31937074)
I've put in a hard block for all crawlers on all pages. Works for my scenario I think. Hopefully they don't lie in their user agent. Then it's going to be really bad.
[ Parent | on HN ]