For what it's worth: Wearing hand me down clothes has been the norm throughout most of modern human history. To the point that it's been a major influence on fashion. For example, a lot of the ribbons and trim on Victorian clothing was a way to cover up where the clothing had been altered or repaired after being handed down (often from an employer to their servants).

I don't say that to be critical if wearing previously worn clothing bothers you. I just bring it up because sometimes things stop bothering me once I realize that they are fairly common experiences.