Being excluded from a group is a pretty severe penalty, emotionally. Our instincts associate group membership with survival. Membership in groups can have significant impacts on the quality and status of contacts.

If wearing a t-shirt once can make others feel uncomfortable and not included, and this situation is wrong, then it is also wrong to permanently or too severely sanction the t-shirt wearer. Such a situation should be discussed calmly and resolved.