Maybe we should not all buy houses. After all, at the moment of out birth nobody decreed "This person is a house buyer". Maybe some of us should build our houses, which will almost certainly come out cheaper than buying. This is another choice we can make. Maybe one can buy a house in another area without getting a loan. This is another choice. Acting like someone else is forcing our choices on us I think it's ultimately self defeating.
Another thing to consider is that using the banks' money to buy houses inflates the price of the houses similarly to that happened to college tuition.
Loans do increase costs in asset inflation. At the same time they increase home ownership. Also it's not the same thing as college tuition. Bankruptcy is an option on home loans.
Is work bad, somehow? Should one get a house without work, simply because one wants a house?
You should read about the veil of ignorance: https://en.m.wikipedia.org/wiki/Veil_of_ignorance
We live in society because at the individual level each of us gets some benefits from doing so. When that stops being the case society will cease to exist.
And they would be right. Tell me what percent of the population can buy a house without a loan?
And if you dare say rent, that is just a loan by proxy.
Your ideals don't seem to be in line with how our reality currently works.