News for hackers. Stuff that matters.
Re:Google is the only search engine that works on Reddit now... by sunaookami on Wednesday July 24, 2024 @11:58AM (#41058375)
They serve a different robots.txt to Google: https://merj.com/blog/investigating-reddits-robots-txt-cloak...

You can see it here: https://search.google.com/test/rich-results/result?id=_mYogl... (click on "View Tested Page")

There are no comments on this comment yet.