The value of the building going down on paper is only significant when you denominate it in some currency, like dollars, or hours of labor. When the value of a thing goes from $1000 to $100, the people who lose are the holders of that thing, the people who win are the people looking to buy that thing, they can now do so with 10 hours of their labor rather than 100.