'genuine correspondence' refers to the high level features that are similar in similarly labeled images. For randomly labeled images there is no similarity.

If there is no detectable patters from images to labels, the network does rote memorization. It learns a compact way to remember the label for each image.