>Let's say the British public is willing to accept a fixed amount of immigrants.

Why should they have this power? To use the above example, New York doesn't. California doesn't. That causes some problems re: housing supply, but we've decided that freedom of movement is more important than agitating some locals.