For example, as a party to the war, Britain's navy is of course entitled to fire upon German vessels, or ostensibly neutral vessels clearly operating under German control, in the strait. This capability makes Sea Lion (amphibious invasion of Britain) essentially suicide, German troop barges would be destroyed by British Navy vessels, and even if some of the British vessels are damaged or destroyed in the process the manpower losses for Germany are devastating. However if Britain is not a party to the war, those troop barges can just cross the strait unmolested, with no naval support - right up until the troops disembark and begin seizing control of British ports.
Once they enter territorial waters, and not engaged in 'innocent passage' they are legitimately a target for us to defend ourselves against.
However in 1939, that would have been around 3-4 miles off the shore, so your point largely stands.
Suez?
valuing Jamacia over the American colonies?
entering world war 2 (economically, morally it was clearly correct)
the impact of leaving the EU isn't even on the same scale as these decisions