Yah that's the point and business with less environmental impact will be more competitive. Industries/products with more of an impact will be more expensive, reflecting their true cost.
> Even worse, it just gives more capital to inefficient governments
Most pollution/carbon taxes are proposed to be revenue neutral, i.e. all the proceeds are returned to the tax base. This is also important because like other (non-luxury) consumption taxes, a carbon tax is regressive.
Solar is taking off not because we banned coal, but because it's cheaper than coal. If coal and natural gas were taxed according to their carbon output, solar would be even more ahead, nuclear may become more attractive as well.
Aluminum is heavily recycled not because it's green, but because it's significantly cheaper than mining new.
Incentives work. The free market responds to incentives, and works around regulations.
And what are those? District heating?