Just because he said it in this way doesn't mean you can't think for yourself and realize that it also has a philosophical basis. You are a human. You are capable of your own independent thoughts and conclusions which are as valid as other people's. If you can yourself find ethical reasons to give humans a place to live by default, and I'm sure you can, (because suffering = bad, no home = suffering, true for every human) you just created a philosophical reason for why it might be valid to consider it a human right.

The same philosophical chain of reasoning would lead to government provided boyfriends and girlfriends, so I'm not sure about this line of argument.