Not necessarily. Impressions are important too. Just because you don't think you noticed that annoying (random example) coca cola ad doesn't mean that it won't unconsciously influence your decision to put that into your tray instead of Pepsi next time you're at the grocery store.

I’m probably in a minority but I consciously and intentionally penalize ads that bypass my psychotic-level blocking. Getting me to notice their ad will cost them, I make sure of it with vindictive fervor.

Same, I don't understand why more people aren't like this

Yeah, so they do care about how you feel about the ad. If you associated that ad with bad feelings you might not want to buy that brand next time you see it.