Society as a whole, represented by officials such as elected politicians.

I understand that things are different in Britain, but in this country "society as a whole" doesn't get to run roughshod over the free speech rights of individuals.

Of course not, society shouldn't be able to do this and constitutions should codify individual rights. But on the other hand, freedom of speech shouldn't cover public platforms for outright lies.