> Is this fundamentally different than your next door neighbor replacing their SFH with a 4 story apartment building?

Yes, with actual long-term neighbours I only have to tell them once where the property line is and how to deal with trash pickup. Also there is zoning and bylaws regulating multiple occupancy homes, and I can look that up before purchasing my house.