"Hadrian's wall is still marking the northern extent of the old Roman Empire"
There is another further North - the Antonine wall:
http://en.wikipedia.org/wiki/Antonine_Wall
There is quite a lot of Roman infrastructure North of Hadrian's Wall - indeed I had a wander along part of Dere Street last weekend: http://en.wikipedia.org/wiki/Dere_Street
Also, while the walls that are put along the imaginary lines may have a reality to themselves, the lines are much more fluid and are unbound to the physical items that represent them. Hadrian's wall is still marking the northern extent of the old Roman Empire, however the current border between England and Scotland is much further north and is represented by nothing other than the occasional sign and line of paint and for the vast majority of the length of this line has no indication on the ground of its actual whereabouts.
[edit] And as far as loyalty goes, loyalty is independent of patriotism and is perfectly capable of transcending geography.