I see what you're saying, but "getting rid of trans people," is not an academic issue. It's an issue of whether you invite them to parties, or try to push them out because they make you uncomfortable. We should not let the meta-meta-debate (the debate about whether or not we should be allowed to debate the metaphysical structures of the issue at hand) distract us from the decision we really need to make, which is how to act towards others when they are standing right in front of us.