> I certainty don't cook up elaborate schemes to avoid paying taxes. Does that make me stupid?

Tax avoidance is legal, and if you're overpaying, it means you're giving the government money which you could have used in the meantime. I prefer to keep my money.