> I do not have sympathy for the notion that free speech is the only right worthy of protection

This belief is held because all rights flow from free speech. You can't have any other rights without functioning & free discourse.