Although I was more referring to our systems more broadly (health care, education, transportation - the topic of this post), let's go with neighborhoods. Are you really trying to pretend that red-lining didn't happen? Or that de facto sundown towns didn't exist at least into the 1980s?
A) Every bank is run by racists who are sufficiently racist to ignore a profit opportunity
B) The neighborhoods are bad credit risks
When people refer to "systemic racism", the "systemic" part is typically literal.
Also, I invite you to take a step back and interrogate the examine the implicit premises of your question. I think you're saying that _in a free market of rational agents_, it doesn't make economic sense to not issue loans to people who _aren't_ credit risks, and I would agree -- except housing segregation was always about a heavily artificially manipulated (not free) market, in which people of color couldn't purchase a home in a white neighborhood regardless of their willingness to pay. Public policy bent over backwards to coerce all parties to maintain segregation (e.g. sundown towns, racial covenants, etc), ironically including during cold-war years when the US simultaneously tried to be a global advocate for free markets.
Also, your ratios are absurdly out of wack. 79% of the country doesn't live in a ghetto and you don't need to be economically or socially privileged to maintain a nice neighborhood. Most working class neighborhoods are not ghettos, nor even resemble one in the slightest.