German reporting in. Disclaimer: I am biased as I think immigration is great and I wish the process was easier and faster for those seeking to live in Germany. I think your observation is sadly very correct and this minority is very well measurable and concerningly large and growing in a lot of places. Just look at how many people vote for the AfD. Those are the ones having that concern. Luckily some places(e.g. Hamburg, Berlin) are on average more open to foreigners than others (e.g. Sachsen).