We're not talking about giving loans to people who can't afford it. We're talking about giving loans to black people.

Nobody is arguing against fairly assessing an individual person's ability to pay off a loan - the issue at question is whether it's okay to use race as a statistical proxy for that.