At the level of object recognition we are discussing now, the "constraint" (more accurately learning bias) comes in the form of very advanced neural architecture that is able to learn in spatial environment. Not in some kind of pre-trained neuron weight collection.

We have some very particular biases like fear of snakes or heights, but learning to recognize spatial objects is something very general.