Re:Reddit has updated its robots.txt to block all web crawlers
by Expurple on Thursday July 04, 2024 @08:26AM
(#40874346)
Kagi in particular shouldn't be affected. Apart from using its own index, it also aggregates results from other search engines, most likely including Google. https://help.kagi.com/kagi/search-details/search-sources.htm...
[ Parent
| on HN ]
There are no comments on this comment yet.