The 'most vulnerable' rarely are living in single family homes. They are living in either public housing, a trailer, or crammed into illegally over-occupied studios.

That said putting more restriction on housing (even more taxes!) isn't going to improve the situation. Housing needs deregulation, not more regulation to distort the market even more.