They're learning features, not the exact image (that's why it's so good at self healing). It should be invariant to shifts.