To be honest that topic people can debate. Men are allowed to walk around without a shirt. Women breastfeed in public pretty frequently.

There is however a long history and tradition of humans wearing clothing to cover their genitals. Even very primitive societies have this norm, and it has pretty obvious reasons behind it.