For instance, my country only started existing in 1991. But we have written records of people speaking our language and thinking of themselves as us going back to 800 AD. Germany can trace its origins straight back to The Holy Roman Empire, the ruling classes of which spoke German, thought of themselves as Germanic, had the same crest as Germany uses now, and started existing as a state in 962 AD.
And so on.
It's less about genetics and more about language.
So you get situations where 'low skilled' jobs pay peanuts, but end up being taken by people who send the money back abroad where the amount is more valuable than in the UK. It can sometimes lead to people from poorer backgrounds not getting these basic jobs because the employers know they'll want a wage they can actually live on.
That said, that's not really an issue with immigration specifically; anyone who immigrates to the area and knows about the minimum wage and decent working conditions will also find it more difficult to get a job.