If you’re okay with all of that as the price of you getting to live in an eternally quiet neighborhood (that your children will never have a similar opportunity to live in themselves due to zoning-driven real estate prices going far beyond what standard wages can afford), then sure. As long as you acknowledge what consequences your desires have on wider society, then you can say you think the price is worth it or that you don’t really care.
The problem with zoning, is that it isn't voluntary.
Zoning is assigned by democratically elected administrations. HOAs are restrictive covenants that are required for the purchase of a house. Every single thing identified as NIMBYism could be enforced by covenants, and keeping blacks and Jews out was literally their original purpose.
The first zoning law in the country was in Los Angeles in 1908. Part of the law was crafted to force certain businesses to relocate retroactively. It was crafted specifically to target the Chinese businesses, which were the laundromats. White people just did not want to live alongside Chinese people.
Redlining was a further practice of both bankers and zoning having restrictions which were explicitly racially motivated. Levittown, the first planned community in the United States, was very explicitly "not mixed" - it had racial covenants that restricted blacks or jews from moving in. The intent was to sell more homes, as they presumed white people would not want to live in "mixed" areas with neighbors of an undesireable race. That practice continued throughout planned communities and zoning laws all over the country. Many of those racial covenants are still in place today.
As an aside: you can let your children go outside in most cities. The moral panic over children getting kidnapped or abused if they step foot outside the house has been overblown for decades, and at this point is just a bizarre psychological trope of America.
Yes some of prefer zoning to "mixed" and "diverse" neighborhoods. What's wrong with me not willing to see a laundromat or an office building next to my house? Or what's wrong with me willing to live in quiet family-oriented neighborhood, where I can let children go outside alone since age of 6-7?