As a practical matter that means no one except the very richest could live anywhere and have any control over arbitrary construction happening next door or their neighborhood as a whole. There’s plenty of precedent throughout history of groups taking collective actions based on the will of the majority.