News for hackers. Stuff that matters.
Re:“Magic links” can end up in Bing search results, renderin... by Gigachad on Monday June 27, 2022 @07:45AM (#31893193)
“Private links” should be covered by robots.txt. The only case I see this happening is for those “anyone with link” shares and those are easy to cover.
Re:“Magic links” can end up in Bing search results, renderin... by rsbadger on Monday June 27, 2022 @07:55AM (#31893278)
AFAIK, most of those "private" links are actually just "unlisted" but they're still public. I'm sure Bing is indexing those too...
Re:“Magic links” can end up in Bing search results, renderin... by Gigachad on Monday June 27, 2022 @06:53PM (#31901983)
Anything private should ideally be put behind authentication. If that isn't possible, than robots.txt. Search engines are _meant_ to index everything that is publicly accessible and not blacklisted on robots.txt.