The displacement of whole groups did actually quite a lot. The Indian Removal Act was an actual policy, not an accident. There was whole ideology and policies around who gets to have which rights in the states.