Photons only travel at the speed of light in a vacuum, when they're not interacting with anything. Throw interactions into the mix, and they go much slower.

The light produced by fusion in the sun's core can take up to 170,000 years to escape! Plenty of time for the angular momentum (or any other property) of the light to change.