Perhaps repairing the houses would be less efficient than building new apartment blocks, I'm really getting well beyond my knowledge or expertise. But I'd somewhat presume that instead of building new high rise apartments downtown it would be more efficient overall if we refurbished some of the crumbling residential areas.
Course that only applies to older cities mostly on the East Coast.
The cost of the housing stock is of minor importance in these arguments, and nobody suggest tearing down existing houses just for the sake of efficiency. That wouldn't make any sense.
(A house build and paid for once can stand for hundred years or more, but only with a constant expense on maintenance in either money or sweat.)
What we want is denser urban cores. That way there will be less sprawl, and even the country pumpkins would have shorter commutes, because the countryside could start so much closer to the city centres: given the same or even larger number of people in them cities, they would take up less space.
But I guess I'm really getting into the definition of efficiency. I suppose in my mind I'm considering clean energy as more efficient even though from an economic POV fossil fuels are still more efficient based on price (though probably not for long).
So in conclusion, you're right. I'd just add the caveat that faced with the reality of a mostly uncoordinated system run by large groups of people with competing interests, you can possibly find higher efficiency (depending on how you look at it) from making your own intelligent individual decisions while living in a large home away from the city center.