Sure. There's also the converse situation where people who speak in tonal languages might not develop associations with melodic patterns in speech and any strong meta-meaning, since in those languages, pitch is actually carrying top-level meaning.

People who have congenital amusia, iirc, also tend to struggle with understanding tone languages. It seems true that if you aren't able to distinguish pitch well, you aren't good at encoding/decoding messages that are present through the medium of pitch differences.

I didn't mean to suggest above that this is a general thing for all humans. Like every other recreational stimulate-the-senses activity, some people don't actually care for it/aren't affected by it anyway.