News for hackers. Stuff that matters.
Re:“Magic links” can end up in Bing search results, renderin... by cube00 on Monday June 27, 2022 @08:28AM (#31893584)
That is baffling logic. Sure, they think they know best and want to ignore the wishes of the owner of the web site. Why then respect a NOINDEX meta-tag instead of robots.txt?
Re:“Magic links” can end up in Bing search results, renderin... by rsbadger on Monday June 27, 2022 @08:41AM (#31893733)
Exactly - seems the safest way is to explicitly block known bots by user agent from even reaching pages you don't want indexed.