Copyright has an exception called Fair Use, where one of the main purposes is to support education, or perhaps training. The legality is not clear here.

Again, why discriminate against one or more groups? Are you going to ban Common Crawl from accessing your content? That is being used for training, but many more things as well.