I think the main point to take from OP is that houses have gotten much more expensive because builders presuppose the existence of a pool of people who can afford them given mortgages. If mortgages weren't a thing a lot of building code wouldn't exist and houses would be built smaller and simpler because otherwise they wouldn't sell.