My uninformed opinion: lots of speculative execution is good for single core performance, but terrible for power efficiency.

Have data centres always been limited by power/cooling costs, or did that only become a major consideration during the move to more commodity hardware?