Americans almost never use off-shore tax havens, because the IRS has no boundaries on chasing them down. US income is taxed globally, and the IRS will destroy you if you attempt to hide it from them and they find out, which they almost always do (they have direct or indirect access to nearly all global banking, financial transactions, stock transactions, bond purchases; they can also directly or indirectly get access to nearly all banks accounts in first world nations through treaties). There are very few countries where you can even attempt to hide your money from the IRS now, and most of those you'd be a fool to park money in.
I think the % of Americans doing the off-shore thing is very very low.
Now from a raw $$$ standpoint, perhaps it is a problem. Is 10% of wealth hidden offshore by the .1% of abusers? Or is it only 5% I doubt anyone knows for sure. I suspect it is less than the "legally" held offshore money using the double irish and other such accounting tricks.