You can try to change the direction your polity takes with its stances towards others. You can leave if you don't approve of those stances and see no signs of changing them. But the question belies a fundamental misunderstanding of...yanno...why polities, why politics, exist.
Plus, there's actual reasons to think completely open, unhindered, and uninspected trade is not desirable. Think human trafficking, etc.
Although, if the British public really want the 2013 horse meat scandal and the 2017 Grenfell Tower disaster to become the norm rather than the exception, I guess now is the time to seize the opportunity.
Governments obviously have a real interest in what their citizen do regardless of where that activity takes place.
I'd argue the former is fine and the latter is still not fine. So international trade agreements are surplus to requirements, since basic decency is enforced anyway.
This is where you and I fundamentally disagree about how trade works.
If I want to trade with a person in a foreign country, I don't see why our governments need to even know, let alone come up with some agreement. If the foreign person and I can agree a deal, why can't we trade without asking permission from our governments?