When people buy housing and leave it empty, they are buying the land, the house is a bonus. People never buy housing as an investment unless they use it to reduce the cost of living (pretty much never) or rent it out (happens a lot). Buying land works fine because of rent seeking.