I think you're conflating the two different definitions of racism here. In one, something is racist if it has different impacts on people of different races - not due to their race, but due to some correlated variable. In another definition of racism, something is racist if it uses race as a determining factor in behavior or treatment.

Providing aid to low-income families is racist by the first definition, but not by the second. But (damn near) everything is racist by the first definition.