While those are the types of people most likely as a group to commit crimes, that doesn't means any individual does. Many of them are harmless, and know how to survive, and even take pride in their independence.

While I'm sure it is in your favor, if those who are harmless are taken off the street in addition to those who are harmful overall it is a loss.