The anti-establishment sentiment is so bad that it also rewards whoever shouts the most outrageous things; if you call them out on it, you're obviously part of the establishment.
They are racist, and are being rewarded for racist statements (e.g. Wilders getting a crowd to shout "Fewer Moroccans! Fewer Moroccans!", or Trump's Mexican wall or keeping muslims out of the US).
You are grouping a bunch of very different people into one group the very thing liberals are normally quick to react to when it's done by the right.
You are part of the very reason there even is a right wing.
But each to their own of course.
Or if you insist on you own interpretation. You should instead ask yourself why more and more people buy into that view. The answer to neither of them are racism or fascism.
The left ignores them completely. So they are grasping for every straw they can.
Just ask the unions. They are increasingly fighting against the cheaper labour in ex. construction undermining the salaries of their own national members.
The left have no response to that what so ever.
Globalization is the problem, technology making jobs obsolete is the problem, natural limits to growth of world economy are the problem, climate change and energy crunch will be huge problems for them soon. But those are hard to explain and much harder to solve, so the idiots win.
Edit: Sorry, I read "refugees" when I saw you mention immigrants. Cheap labour from inside the EU is a real problem.
Stop immigration.
I am sure calling someone an idiot just because they represent another view than you is under your own normal level too.
You aren't an idiot just because you are skeptic towards immigration. National Conservative is a totally fair position to take.