Poor people are more likely to be victims of low-level crimes than rich people for a variety of reasons. When criminal immigrants come in, it's poor people they victimize.

It's also poor people who must compete with unskilled immigrants for jobs.

Rich people benefit from low-skilled immigration. They can isolate themselves physically from the bad immigrant neighborhoods, but also hire those immigrants to provide services for them. The immigrants will push down unskilled labor prices by the very simple laws of supply and demand. The immigrants will not compete on the labor market with the rich.

This is why the rich in the modern world have always been the ones pushing for more immigration, and the poor have always pushed against. Upper class businessmen and media people strut around like they're MLK but they really just want to pay their maid and gardener less.