The right view is, if you want to put it simplistically like this:

Progressives: Elon doesn't care about free speech, he cares about limiting the speech of progressives in favor of the extreme right

Also progressives: Free speech should have limits to protect minorities from aggressors

Nothing at all inconsistent about these two positions, regardless of whether you think that either one is a good idea, or even true.