I don't feel that he is was trying to convey a literal conspiracy. It seems to me like he is saying that he does not like the racial culture of that area and that some African-Americans contribute to the culture in such a way that helps keep the negative dynamic going.