If your co-worker is allergic to peanuts, are you going to moan that you're not allowed to bring in your famous peanut brittle? No. You're going to be sensible and realise that excluding people or risking them harm isn't nice.

And, yes, I'm with Popper. The "Paradox of tolerance" is real. It's OK to tell intolerant people that they're not welcome.