> but if we're being fair then the provider should have the right NOT to serve you data based on what you intend to do with it.

Technology is a tool, and the world is not fair. I'm not sending you intention HTTP headers over. I make a request, you send me a response, I do what I want with that response. So sorry that ruins your business model.