The thing about externalities is: somebody pays, it's just not the person who caused them. Redirecting that cost back to the source would be a good thing. There would then be incentives to do the most efficient thing instead of the most wasteful thing. This would actually make everybody richer.

How much of our wealth is being wasted this way? I'm guessing that it's a lot.