>I counter that if this were the case there would be no need for single-family zoning, because people would naturally choose such housing whenever possible, and the market would respond.

This mistakes the price one person can pay for a piece of land with the price many people can pay to to use the same land. A single family home does rent for more money than a condo if they are on the same block in the city.