It gets tricky because "society" is an ambiguous word.

Is it just a public sphere that needs to observe tolerance or is tolerance something demanded of companies, associations, churches, families, internal thoughts, etc

As your demands for tolerance become more pervasive, you invite authoritarian tendrils into increasingly private spaces.