The country has a huge housing crisis, young people rank it as their biggest problem by far. Bringing in more people to further drive up the cost hurts Americans.