It's not really about liability, but whether it's warranted to object. You can say whatever you want, but you can't expect others to not say what they want back unless what you are saying is measured. Objecting to what other people are saying isn't stifling of free speech, it is free speech itself.