The equating of "poor" and "problematic" is part of the issue here, and itself has a lot to do with the effects of concentrated poverty. A building with 15 or 30 units of people under the poverty line in an otherwise middle- or middle-upper-class neighborhood that's similarly dense is hardly going to cause noticeable problems.