It's certainly as voluntary as a HOA, which were originally called White Homeowners Associations.

Zoning is assigned by democratically elected administrations. HOAs are restrictive covenants that are required for the purchase of a house. Every single thing identified as NIMBYism could be enforced by covenants, and keeping blacks and Jews out was literally their original purpose.