It's like going to Fry's and shopping for components to build a new computer - why do you think most contemporary non-geeks say, often, that they "hate shopping for computer parts"?
I would like all people in the latter category to stop caring about choices of clothing as a factor
I'm surprised you would say that - you may begin to notice that humans aren't computers with predictable API's to interact with. Inter-human communication and interactions are largely driven by sexual (perceivable or not) and biological queues. Smart and attractive (if you can dress well and take care of your body, you will be attractive) is an extremely powerful combination because the ultimate fate of humanity rests in the hands of our intelligence and a lot of the world will acknowledge you for your intelligence but if you want to make a serious difference - putting yourself together in a way that many non-geeks can relate with is crucially important.
Oh and clothing was never actually made to fit your particular body style - it's meant to be generic, you gotta get that stuff tailored! It's like custom fitting a computer for your needs, you have to do the same thing with your clothes, your body.
I once had the outlook you do, why do people like "clean" and attractive people so much? Why don't they see my intelligence more? On and on and on...
Ideally, I would like all people in the latter category to stop caring about choices of clothing as a factor, but that won't happen any time soon, and meanwhile I choose to put up with the way the world works by acting accordingly to get the result I want. Ideally, I want to spend a minimal amount of effort achieving both of those goals, so I can spend time hacking on something useful.
So, I'd welcome anything which helps me put less thought into the the myriad incompatible standards for "fit" and other factors that determine comfort, and less thought into the myriad unwritten rules that form the collective expectations of shallow people ("fashion").