Not necessarily, if I'm listening to an album because of the artist then sure, the producer should be transparent and fade into the background. If I'm listening to an album because of the producer, I probably want to hear them add their distinctive touch. Danger Mouse, Madlib and Dan the Automator are examples of producers with very strong individual sounds and I'll make a point to listen to albums they've produced regardless of the artist or genre.

I guess listing hip-hop producers here is a bit unfair, since a large reason I listen to any given hip-hop track is because of the production, but Danger Mouse has produced rock albums that have a definitive Danger Mouse sound.