Plenty of people voluntarily leave work. I did it last year for eight months to travel. It didn't hurt my self worth, nor those of my friends who've done the same. But if I had wanted a job and not been able to get one, I think that would hurt my self-worth even if I didn't need the money.