The problem is that people like Musk have spent ages arguing that banning fascists is bad because free speech absolutism is an important value. It turns out that free speech absolutism was never actually a value they cared about - the only thing that matters is that their guy is the one choosing the bans. If people like Musk had instead argued that platforming fascists is actually good this whole time then the discussion today would be different, but because they didn't want to publicly support fascists they had to fall back on the free speech absolutism argument, which has shattered into a million pieces.