Thanks, I was mentally ignoring the distance thinking it was not a big factor.

Being close to the sun (in angles from our viewpoint) makes sense, since the sky would start getting light when it was visible.