Nobody is forcing them to build this housing on their property. They own it, and it's theirs to do with as they like. They DON'T own the neighborhood and when others want to move onto another property they have no ownership interest in and that happens to be on their block, they don't have a property right to prevent that.