Oh sure it does but that same free speech lets users call out speech they find provides little or negative value to the community.

It'd be different if said comment was deleted/removed but users downvoting it for not being conducive to conversation and calling it out as needless and low value isn't impeding the free speech by any means.

Free speech != speech free from criticism.