You also "need" to have growth because the population grows. Simply, if GDP or energy use is flat, that implies lower GDP or energy consumption per capita. The latter may be explained by efficiency, but the former would imply reduced standard of living.