I've noticed the same effect but kind of the other way around. When I'm doing programming that requires thinking outside the box and creativity, music is ANNOYING and disruptive.

I love listening to music while pixel juggling UI's or fixing bugs but as soon as I start working on a scheduling algorithm or something similar I have to turn the music off.