I’d suggest “The Color of Law” for a better rebuttal to your argument than I can provide here. Zoning absolutely has been an important tool in establishing and maintaining segregationist housing aims where more explicit policies like restrictive covenants were rejected by the courts.