People use terms like "get your hands dirty" to describe programming. Programmers are usually not encourage to wear button-down shirts, suits, etc.

You're basing this view on a very small subset of companies (startups). the vast majority of places where people work still expect professional dress above the level of t shirt + cargo shorts and flip flops.