I'm roughly the same way. When driving the choice is that I either miss something on the road or miss something on what I'm listening to.

I usually take public transit to work, but the buses are too noisy for me to actually get anything out of a podcast. I could use noise canceling headphones, but I find those just make the bus sound weird instead of getting rid of the noise.