Emitting carbon is just that, an (unintended) transformation of having energy. Yet we are trying to curb it, and we could do the same with the rest. It't not necessary that all transformations will leave permanent ecological effects. For example, vast amounts of energy could be used to ferry people from Newark to Tokyo for shopping trips in some electric craft that will leave behind only a slight temperature rise of the atmosphere.

I do agree though that with unlimited energy many people will want multiple vacation mansions each somewhere in the wilderness. We need to handle that like we do with carbon emissions, limit it and tax it to high heavens.