To be clear, the grandmas can refuse to move out, and it's their right to refuse. What's not their right is to have veto powers over what is built on adjacent properties they don't own.