I think in a true efficient market there would be no arbitrage between renting and buying. There would just be oscillations around an equilibrium.

I would suspect permits/zoning and whatnot that cause inefficiency to the markets cause the oscillations to be wider than they should be and harder to get back to equilibrium.