Two sides of the same coin.
A large section of people are left out of benefits of improving economy. Lions share of the gains go to the Uber rich people. And politicians play immigration card to whip up their voter base.
More or less exact phenomenon played out in Bombay, India. Except that the immigrants were Indians from other states (Gujarat, Tamilnadu etc). But when the political party did come to power they did absolutely nothing to improve their voter base’s life. Bombay continues to be a shit hole, worse so, that it was and the city floods every monsoon like a clockwork.
In the South of England, maybe. In the North they barely exists, here "the enemy" continues to be South-Asian communities (which, ironically, were also heavily pro-Brexit, because of the correct calculation that British policies would then be forced to fall back on Asians for cheap immigration).
Even in the USA, the nation of immigrants, where we assimilate immigrants the best (comparatively), increased immigration has always leads to a reactionary backlash.
Being very pro-immigration, a big of Matthew Yglesias's One Billion Americans thesis, I have no clue how to move forward.