Since people were treated separately based on their race (slavery, no right to vote, no civil rights, redlining, segregated schools), it's not a surprise you can still measure the impacts of that decades later, based on race.

It takes a long time to undo damage like that.