Right, but the context is that these problems comprise an evaluation suite for artificial intelligences. Even simply textually describing the shapes on the left and the right, is an accomplishment.

A better test suite would likely provide an oracle capable of generating new images belonging to the left or right and asking the program to judge which side it belongs to.