Free speech does not mean you get to yell at me. In the same way, banning ads where they are shown to users without their consent would not mean violation of free speech.