What you notice is a really subjective argument. I notice ads, even "small" ones; they distract my attention, and annoy me.

I'd wish I had your ability to "rarely notice banner ads", but I don't, so I complain.