You'll meet suit-wearing people, business casual people, and pizza-stained-hoodie people. Some will be conventionally attractive, some not. Some old, some young, some male, some female, some of one race, some another. Some will be skilled, diligent, and productive, some will be well-spoken and good communicators, some will be honest, some will be punctual... some will be not.

Some of those things are choices that matter and should impact your respect for someone else. Some are not, do not, and should not.

Personally, as a controls engineer who frequents messy manufacturing facilities, dressing in a suit gets in the way of getting work done. It subtly conveys "I'm too important to get my hands dirty, I'll leave the grunt work to the grunts." That kind of unwillingness to do whatever's required to get the job done is a point against those folks in my circles. I do understand that people who come to work in a suit may have different struggles vying for status and trying to send the right social signals in conference rooms, and I don't envy them those tasks - but please don't think less of me as a human because of what I choose to wear.