Is the person who comes in to shout down the speaker not exercising their right to free speech - or should it be restricted in this instance?
As the saying goes "Your right to swing your arms ends where my nose begins." Shouting someone down who is speaking to an audience that explicitly came to listen to them in a venue they arranged for isn't "freedom of speech", it's disruptive and a form of trespass. It's also made worse by the fact most of the things being shouted when this happens is arguably slander.
In the cases I'm mostly referring to in my comment, the "platform" was perfectly fine with the speaker, and invited them (or accepted their money in exchange for use of the venue), so, yes, their freedom of association is /also/ being violated when someone comes in to shout down the speaker.