The implication in his argument was that prices will increase in general.

My argument is that we don't know what the overall effect will be.

Edit: In other words, if housing increases by $10 but the cost of other stuff decreases by $20 then you still come out ahead.