All they see is probably what they watched on the TV show Silicon Valley or what they hear in the news. I fully believe that if things were improving for them, they would be welcoming immigrants with open arms (or at least not minding them). However that is not the case. So in an environment where there isn't abundance but scarcity, it is a zero sum game.
The solution to this issue is not a "conversation", its action. Obama was elected in a massive landslide by these very people because he promised "Hope and Change". Instead he accelerated efforts to further destroy what little the middle class had left. So as a response, the people elected a populist who promised to stop the bleeding in an aggressive manner (ie. stop immigration). He did not fulfill any of his promises and now we are left with a population that is even more angry. The next step is going to be even worse.
Immigrants don't "destroy towns" they reinvigorate them[1].
1. https://www.forbes.com/sites/ashoka/2017/03/02/why-embracing...
The only hope I have is that most efforts to automate real software development have fallen apart thus far and that it is hard to do this job for many people trying to "learn to code". However I worry about what AI advancements will bring. No way to know until it happens...