The web already has that kind of DRM and always did: robots.txt, enforced by social convention rather than encryption.

And yes some companies ban crawlers and try to get their content out of search engines for questionable reasons. More often, they try to strongarm Google so their content is still there, but they get paid for the privilege, which is not a reasonable approach and thus not supported by the robots.txt "DRM" protocol.