There are hundreds of millions of nominally reasonable people who fall into opposite tribes just by happenstance. If you attack their tribe as a whole they'll stick to their tribes because of tribalism, but if you act reasonably, even if the tribal figureheads are acting in bad faith, the members of each tribe can be persuaded reasonably.
Every line in tribe B's media about how party A is destroying the world with its anti-X agenda is perfectly mirrored by a similar line in tribe A's media about how party B is destroying the world with its anti-Y agenda. "Excluding" doesn't cut off people you disagree with, it makes them stronger, by consolidating them further into their tribes and cementing their opinions ("fight makes right")! We can try to see things from the point of view of reasonable people on both sides, or we can fail as a pluralistic society.
This only works when both sides engage in good faith. That is not the case currently. We are better off excluding them than letting them abuse the process in bad faith like they always do.
The ones advancing this argument are always the ones with the least at stake.