On a separate thread - want to say that I don't think pay-per-crawl (a la Cloudflare) is a viable model. I think a better approach is to go via the usual licensing contracts. See my blog post: https://developerwithacat.com/blog/202507/cloudflare-pay-per... and an example with OpenAI / Reddit: https://openai.com/index/openai-and-reddit-partnership/