Being online at all exposes you to risk and creates a footprint of your existence. Much like moving around in public does. And just as in moving around in public, the safest and most private thing to do is to not be in public at all.
Personally I block ads because I value my attention higher than advertisers value it. There is always an adversarial function built into ads; the advertising wants your attention, if nothing else, while I am interested in maintaining my focus. For similar reasons, I disable auto-suggest in Google search, animated gifs in the browser, and I use flashblock in all browsers that support it.
Anything continuously animated on the page whatsoever - no matter whether it's an ad, a subscription div popup, a "read next article" popup link, or a sharing toolbar - I block them all with element hiding helpers.
Because the greatest risk to me in browsing a random site is getting distracted and sucked down some rabbit hole. I use all the tools at my disposal to eliminate visual distraction.
By blocking adverts, you're harming the people who make the things you like, in direct proportion to how much you like their content. The more you visit their site, the more load you make them pay for without giving anything in return.
If you're okay with harming others to keep yourself safe, and harming your ability to consume additional content from the people you want to consume content from, then fine. Continue to block ads. But know you're part of the problem, and are being selfish.
I don't block ads but I do use NoScript which means I rarely see them. It is increasingly common for pages to load scripts from dozens of different providers and those sites I generally turn away from.
If you want to hobble around the web like it's 1995, that's your business. If you want access to content that's paid for by adverts, however, you need to be counted. That's the only way that content will be produced at all. You're not only harming the content producer, you're also harming yourself by lowering the number of interesting things in this world.
The safe thing to do is to block Ads by default. And only disable them when they've shown that they're not just letting mass third party Ad networks embed arbitrary script in their page whilst harvesting your private information.