Because I cannot trust ad networks to get it right 100% of the time, both content-wise as well as safety, out they go.
This is definitely the common justification for ad blockers. As I said in another comment: ad blockers themselves are a potential vector for malware.
In practice, ublock origin and you're good.
I am glad to see we agree that adblockers are justified.
Now adblocking is simply a matter of security.
Websites can inject malware irrespective of ads. Not to mention that ad blockers, themselves, are a good vector for exploitation. (Another consideration, obviously, would be to avoid websites that show you ads that you don't like (or fear) rather than circumvent their only path to revenue.)
I generally count on Google (and Chrome) to prevent that. At the risk of jinxing myself: I've never had malware installed on my computer view a website.
I don't find ads all that bad. But I will avoid sites that go overboard.
I also take care to report spam messages in my email. And I ignore phone calls from anyone I don't know.
So I guess I straddle the line between the two people you describe.