I disagree. Human time is not a problem. Yes, in a moral world it would be the most important metric. But nowadays, labour is cheap and abunant. That's why we don't have robotic armies doing stuff all around us - it's cheaper to make people work. We're energy-bound as a civilization now (or, one could say, still).