I don't think I have a problem per se with the notion of borrowing money, if that's what you are asking about.

I personally don't have an issue with you finding people who help you with building the house that agree to do that for some payment.