What you just described is called "systemic racism" where the power structures and the rules were established to perpetuate oppression, but done within the rule of law so that no individual in the system seems explicitly racist. If you're looking for a bureaucrat in an office making a decision because they don't like black people, you're not going to find one. Instead, you're going to find things like, e.g. redlining and the interstate highway program.