This does happen, but maybe not in all cases. I've had it happen where lane change is no longer supported (and you get a notification) because the sun is blinding one of the pillar cameras.