>Considering that a median house still costs 4x yearly median salary means that not only do we live in a resource-scarce world but we will continue to for a long time.

Are housing prices, at least in the U.S. actually attached to the value of work, or they mostly affected by the banks willingness to hand out money?

Let's go another step and take work out of it completely. If houses were free, there would still be houses that are worth far more than others, simply because of proximity to other things of human interest.