Your last point is very important. Zoning at a federal level would be required to clear some basic anti segregation. Would it be perfect? No. But the zoning in my town is 100% in the same spirit as redlining. No one would describe themselves as racist or classist. Maybe that's just human nature?