Yeah I had this idea too. I stayed with some people in a fancy apartment in Zurich for a week a while back. They all left to work and I worked from their home. It was the best office I'd ever had, and was empty during work hours all week. I reckon 60% or more of city apartments are similar - seems very inefficient.