It is only a feature, because you have the information about which rotation you provide and relate it to the result. If I just try to classify an image the information about which rotation the image is under might be not there at all. Just an example. Say there is a drone: The Elmer-2 that takes an image of a sign. Now depending on which angle this picture is taking from it might think it is duck season instead of rabbit season and never look twice.