On the other hand, I can't listen to Bob Dylan or Eminem [1] without hearing the lyrics, because in their case the music is really just there as a scaffolding for the words.
[1] How's that for a juxtaposition?
Aside from the obvious case of scat-singing, examples that come quickly to mind are Frank Zappa, Presidents of the USA, and Rob Zombie. I lot of the lyrics on King Crimson's Discipline seem to almost make it explicit that the lyrics themselves are an appendix. (I recall an interview with Zombie: someone asked him what some strange lyric was supposed to mean, and he replied something like "I don't know, it's just the song").
But it would be wrong, I think, to assert that instrumentals or lyrics for the sake of the voice are somehow on a higher plane. I think that being able to produce excellent melody and harmony as well as excellent lyrics, and to integrate them well, is the highest form.
For me, music has always been about structure, tone, melody -- I like the Eagles, for example, but when I started hearing the lyrics (it took me a while, and they're pretty easy), I was like, "Man, these guys are cheesy!" In some agreement with this article, I love jazz. Check out my friend Daniel Levin for how far out I like it: http://www.daniel-levin.com (annoying flash site but has samples of his music)