You also have the issue of people who move to high cost locales, raise kids and then their kids who especially can't afford it move away (or wait to inherit the house from you).