> but start to face the ... animals, police, theft, physical danger and more and those As aren't going to remain As for long.

These are the real dangers that a roof and walls offer you protection from. If you happen to find a benign niche where you don't face these threats, it's likely because there is an invisible layer of defense being provided to you by the societal structures around you.