Maybe it is a generational or just personal thing.

I feel restricted / unnatural and generally unhappy if I have to wear those sort of clothes.

I've noticed a lot of people in the current generation wearing more formal clothes at work, I guess this is a cycle, and us 40ish year olds in T-shirts were doing the opposite of those who came before.

Honestly I find it weird to hear what seems like quite young guys on the train to work having a conversation about the best shoe polish.