You can use your free speech to tell others not to do business with X. When enough people are convinced by that, it's a boycott.