Plus the total consumption of a CPU doesn't actually go down, they just do more with it. They look at thermal limits more than power consumption, like, how much work can we make it do within these temperature ranges.

Mobile chips are a bit different, but to a point it's the same story there. If you put the chips of today in the smartphones of a decade ago they would probably last a week on a battery charge.