In soccer/footbal one can see how not having sleeves is a hit to the space of the walking advertisements that are uniforms these days.

Not having huge variations in uniforms for team sports seems to make some sense to me (you can't have everyone wearing a different color...) for something like tennis or chess I can't see how it matters much.