There is an effect called dispersion, which causes different frequencies of electromagnetic radiation to travel through a medium at different speeds (lower frequencies => slower).

It's strong enough to be noticeable in the case of pulsars (but probably insignificant inside the solar system).