My house has more than doubled in value, and I'm not at all happy about it, because apart from the moral issues of access to housing, on a purely selfish note, I, as most people, are more interested in trading up than down, and as my house has doubled, so have the more expensive houses I might want to move to.

Effectively, rising house prices harm me too, not just first time buyers

House prices increasing are only a benefit to people treating it as an investment, and if it's your primary home, then that means planning for trading down.