Re:Web Search API
by viraptor on Monday October 05, 2026 @04:23PM
(#49970158)
You get to decide per bot. Or per category: https://developers.cloudflare.com/bots/concepts/bot/verified... You can make for that Google or all indexers are always allowed.
[ Parent
| on HN ]
Re:Web Search API
by weird-eye-issue on Monday October 05, 2026 @07:53PM
(#49972360)
Yes of course but most people are not doing that they simply turn on bot fight mode or similar which excludes verified bots...