Most of the tax payer population, but not most of the gains available for taxation. Small increases in taxes to the very wealthy would far outweigh large increases in taxes to the middle class in terms of government revenue.

On top of that, you say "unless you added 20%" as if that's something that's beyond the pale when in fact the wealthiest people pay far less in taxes that at any point in our country's history.