Rebuilding a shitty house is quite possible for a person. Like people can literally build simple shelters in a time frame of hours. It's only because of so many regulations and rules that you have to go into multi-decade debt.

For instance, apparently the EU is currently considering a regulation that houses must be energy efficient. Getting a current house into compliance would cost on average $50k. That kinda stuff adds up.